-
Notifications
You must be signed in to change notification settings - Fork 17
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Upload performance reports #281
Comments
I agree that it would be very nice to have these. Unfortunately, @ncclementi had some WIP for manually uploading them to s3, but it went stale. I don't think there are any major barriers to doing it (I've even built a field into the benchmark schema for including a URL to a performance report, currently un-populated) |
@fjetter we had something working, sort of, but the main problem was to generate a link to be able to easy find the reports in S3. Here is a summary of that discussion and work #107 (comment) |
A way forward there is to use the |
I see... too bad. If this is just about a max limit, we may be able to figure this out. Just in case, I opened #282 |
I'd be OK with this as well but we should check in with platform to see how much work it is to get this working on their side. If that's a couple of hours, it's probably better spent there than for our specialized use case. |
I think you should be fine to use Coiled performance reports. I'm not aware of anything that would block that. There is no limit in how many reports you can make. |
Oh, I see, the older ones are unavailable once you go over 5. |
Discussing here: https://github.com/coiled/platform/issues/57 |
In the next deploy you'll be unlimited in how many performance reports are accessible with the links. They remain accessible for 2 months. Note that even now there won't be any errors if you try to create more than the limit, so you're currently completely unblocked in implementing this change in your CI. |
I believe any platform-related blockers were removed a couple weeks ago. Doing this should be pretty quick and easy for you now, right? |
We were still encountering an issue because the coiled client rejects uploads of larger files than 10MB |
@fjetter Is there an issue or the size blocking problem? |
The size limit is the problem. |
@fjetter is there a github issue for that? It'd help to have a little more info about the problem. (What sizes are you hitting, etc.?) I'm sure we can bump the size limit a bit but it would also be nice to work together a bit to understand what solution makes sense for large performance reports. All that is back and forth we can do in an issue, right? |
Of course, sorry. I was meaning to open one a while ago but didn't get to it, yet. I'll open one shortly |
I'm wondering if there is a reason why we're not automatically uploading performance reports.
using
coiled.performance_reports
we should have them uploaded automatically and persisted, shouldn't we?Having perf reports is useful to debug regressions.
The text was updated successfully, but these errors were encountered: