Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Agentflow Not Functioning Properly in Flowise 2.0.0 #2847

Closed
seonghobae opened this issue Jul 23, 2024 · 5 comments · Fixed by #2858
Closed

[BUG] Agentflow Not Functioning Properly in Flowise 2.0.0 #2847

seonghobae opened this issue Jul 23, 2024 · 5 comments · Fixed by #2858

Comments

@seonghobae
Copy link

Description: After upgrading to Flowise 2.0.0, we have encountered an issue where the existing Agentflow is not functioning correctly. Specifically, messages generated by the Worker are not appearing in the final output.

Steps to Reproduce:

  1. Upgrade to Flowise 2.0.0.
  2. Execute an existing Agentflow.
  3. Observe that messages from the Worker do not appear in the final result.

Expected Behavior: Messages generated by the Worker should be included in the final output.

Actual Behavior: Messages from the Worker are missing in the final output.

Environment:

  • Flowise Version: 2.0.0
  • Operating System: Ubuntu
  • Browser: Edge

Additional Context: This issue was not present in the previous version of Flowise. It appears to be a regression introduced in the 2.0.0 update.

Screenshots: If applicable, add screenshots to help explain your problem.
image

@HenryHengZJ
Copy link
Contributor

This is the new behaviour. Since multi agents are working back and forth between workers, we think the final output should be a summarisation of the whole conversation.

For example. If you have a coder agent and a reviewer agent, and you ask the team to generate piece of code. The expected final output should be the code generated by coder agent. But it will be the reviewer's output.

This new behaviour is somewhat aligns with AutoGen studio
1706155331144

@seonghobae
Copy link
Author

seonghobae commented Jul 23, 2024

The problem with this approach is that when you send a POST request, it doesn't get the right text. I think this behaviour is quite misleading because the current Flowise native chat tool doesn't show all the Agent results either, and the Agent results are collapsed.

image

This is not proper result what I intended as final result! I've spent countless hours trying to create complete Markdown documents using Agent, and my current belief that the end result should be a summary has undermined my efforts. It's not up to the service framework to decide how the service should be delivered. By that logic, even sequential agents should have summarised results, but senquential agents are getting the ‘normal result’, aren't they? The instruction Remember to give reasonings, instructions, and summarisation in multiple agents is not necessary, it's just causing misbehaviour. Summarising only makes sense when you specify some sort of specification, and summarising without any specification is meaningless - what's the point when even the example agent you created is misbehaving?

The reason why you shouldn't summarise is more obvious than you might think. In a model that values economics, summarisation leads to a loss of context.

seonghobae added a commit to seonghobae/Flowise that referenced this issue Jul 23, 2024


🛠️ Supervisor.ts -> Removed summarization fields.
@HenryHengZJ
Copy link
Contributor

Understood, will see if we can create an optional field for supervisor, and provide summary only when user select so

@HenryHengZJ
Copy link
Contributor

@seonghobae changes has been pushed to 2.0.1, can you try and see?

@seonghobae
Copy link
Author

seonghobae commented Jul 23, 2024

@seonghobae changes has been pushed to 2.0.1, can you try and see?

I haven't reviewed the regression test in detail so I can't say for sure, but there doesn't seem to be anything out of the ordinary in our normal testing routine. If there is, I'll reopen the issue.


Query

Find the weather in Seoul today specifically and tell me in English.


Response:

Current Weather in Seoul

  • Current Temperature: 26°C
  • Feels Like: 33°C
  • Today's High: 31°C
  • Today's Low: 26°C
  • Weather Condition: Mostly clear and humid

There is a forecast for thunderstorms from Thursday afternoon to Friday night.

For more detailed weather information, you can check the following links:

image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants