Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature: improvements to evaluations results table #233

Merged
merged 1 commit into from
Sep 19, 2024

Conversation

geclos
Copy link
Collaborator

@geclos geclos commented Sep 19, 2024

Fixes queue ordering as evaluations were being run after all document runts had completed which is not the best experience.

Also added interval fetching of the table data to simulate real time experience.

Finally, added collapsable convos in the log messages section in order to make that section more readable.

To further improve this we need:

  1. Decouple expensive queries from this view so that we can query table logs more freely
  2. Add an independent queue dedicated to running evaluations in order to increase parallelism between document and evaluation runs

@@ -54,7 +54,7 @@ export const withProject = createServerActionProcedure(authProcedure)
return { ...ctx, project }
})

export const widthDocument = createServerActionProcedure(withProject)
export const withDocument = createServerActionProcedure(withProject)
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

typo @andresgutgon 😂

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Damm

@geclos geclos force-pushed the feature/improvements_to_evaluations_results_table branch from c58d6a7 to 1c848d4 Compare September 19, 2024 21:45
Fixes queue ordering as evaluations were being run after all document
runts had completed which is not the best experience.

Also added interval fetching of the table data to simulate real time
experience.

Finally, added collapsable convos in the log messages section in order
to make that section more readable.

To further improve this we need:
1. Decouple expensive queries from this view so that we can query table
   logs more freely
2. Add an independent queue dedicated to running evaluations in order to increase
   parallelism between document and evaluation runs
@geclos geclos force-pushed the feature/improvements_to_evaluations_results_table branch from 1c848d4 to 2bafdc3 Compare September 19, 2024 21:59
@geclos
Copy link
Collaborator Author

geclos commented Sep 19, 2024

🐮 👦🏼

@geclos geclos merged commit c63d36f into main Sep 19, 2024
3 of 4 checks passed
@geclos geclos deleted the feature/improvements_to_evaluations_results_table branch September 19, 2024 22:05
@github-actions github-actions bot locked and limited conversation to collaborators Sep 19, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants