[Bug]: The community formation step gets into an infinite loop after a failure message

[LiorZ]

Is there an existing issue for the same bug?

• I have checked the existing issues.

RAGFlow workspace code commit ID

unknown

RAGFlow image version

g7b5d8312

Other environment information

Actual behavior

To test the community building step, I ran the knowledge graph construction on one document out of ~16,000. It looks like it keeps trying to build a community, fails and then tries again, ad-inifitum.

(see attached log for the repeated steps: log_short.txt)

Here is the failure line
\\\\\\\\", "\\\\"", "\\\\"", ",", " ", "\\\\"", ",", "\\\\"", ",", " ", "\\\\"", "\\\\\\\\", "\\\\"", "\\\\"", ",", " ", "\\\\"", ",", "\\\\"", ",", " ", "\\\\"", " ", "\\\\"", ",", " ", "\\\\"", "\\\\\\\\", "\\\\"", "\\\\"", ",", " ", "\\\\"", " ", "\\\\"", ",", " ", "\\\\"", "\\\\\\\\", "\\\\"", "\\\\"", ",", " ", "\\\\"", ",", "\\\\"", ",", " ", "\\\\"", " ", "\\\\"", ",", " ", "\\\\"", "\\\\\\\\", "\\\\"", "\\\\"", ",", " ", "\\\\"", "\\\\\\\\", "\\\\\\\\", "\\\\"", ",", " ", "\\\\"", "\\\\\\\\", "\\\\"", "\\\\"", ",", " ", "\\\\"", "\\\\\\\\", "\\\\"", "\\\\"", ",", " ", "\\\\"", ",", "\\\\"", ",", " ", "\\\\"", " ", "\\\\"", ",", " ", "\\\\"", "\\\\\\\\", "\\\\"", "\\\\"", ",", " ", "\\\\"", "]", "\\\\"", ",", " ", "\\\\"", "\\\\\\\\", "\\\\"", "\\\\"", ",", " ", "\\\\"", ",", "\\\\"", ",", " ", "\\\\"", " ", "\\\\"", ",", " ", "\\\\"", "\\\\\\\\", "\\\\"", "\\\\"", ",", " ", "\\\\"", "\\\\\\\\", "\\\\\\\\", "\\\\"", ",", " ", "\\\\"", "\\\\\\\\", "\\\\"", "\\\\"", ",", " ", "\\\\"", "\\\\\\\\", "\\\\"", "\\\\"", ",", " ", "\\\\"", ",", "\\\\"", ",", " ", "\\\\"", " ", "\\\\"", ",", " ", "\\\\"", "\\\\\\\\", "\\\\"", "\\\\"", ",", " ", "\\\\"", "]", "\\\\"", ",", " ", "\\\\"", "\\\\\\\\", "\\\\"", "\\\\"", ",", " ", "\\\\"", "]", "\\\\"", "]"]\\\'\', \'caused_by\': {\'type\': \'illegal_argument_exception\', \'reason\': \'Document contains at least one immense term in field="source_id" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped. Please correct the analyzer to not produce such terms. The prefix of the first immense term is: \\\'[91, 34, 91, 34, 44, 32, 34, 92, 34, 34, 44, 32, 34, 91, 34, 44, 32, 34, 92, 34, 34, 44, 32, 34, 44, 34, 44, 32, 34, 32]...\\\'\'}}, \'status\': 400}]}')ctx._source.content_with_weight=params.pp_content_with_weight; ctx._source.knowledge_graph_kwd=params.pp_knowledge_graph_kwd; ctx._source.kb_id=params.pp_kb_id; ctx._source.source_id=params.pp_source_id; ctx._source.available_int=0; ctx._source.removed_kwd=params.pp_removed_kwd;

Expected behavior

The community building steps should be finished in a reasonable time and not run forever

Steps to reproduce

Enable GraphRAG with community and entities recognition

Additional information

No response

[KevinHuSh]

What about changing to another LLM?