ci: add vegafusion in ci checks

[EdAbati]

What type of PR is this? (check all applicable)

• 💾 Refactor
• ✨ Feature
• 🐛 Bug Fix
• 🔧 Optimization
• 📝 Documentation
• ✅ Test
• 🐳 Other

Related issues

• Closes add vegafusion to downstream ci tests #1193

Checklist

• Code follows style guide (ruff)
• Tests added
• Documented the changes

If you have comments or can explain your changes, please do so below.

[MarcoGorelli]

thanks @EdAbati - this is awesome, but " Successful in 27m " is probably too much for every commit 😄

perhaps we can only trigger this one if we apply some label, so then we can just trigger this before releases?

[EdAbati]

Ok CI is green, but it takes quite a lot. Using caching, the build time decreases but pytest takes ~24m (AFAIK similar time as in the vegafusion CI: https://github.com/vega/vegafusion/actions/runs/11419942913/job/31775120908)

Do you know any tricks to speed this up a bit?

Otherwise I would suggest to treat all these downstream libraries tests as "integration tests" and not run them at every push. For example, we could run them just before merging a PR. Is it by using auto_merge_enabled here? (Never done this before though)

Thoughts? @MarcoGorelli @FBruzzesi

EDIT: Marco typed faster than me :D

[EdAbati]

perhaps we can only trigger this one if we apply some label, so then we can just trigger this before releases?

Happy to do that. I don't have strong opinions on what should trigger this or when to test these.

Should we run these test before release and triggered by new tag?

[EdAbati]

not sure if this is what I meant, but now this can be triggered:

• by other workflows (i.e. in the 1st step of the publish workflow here )
• manually

[MarcoGorelli]

let's give this a go - thanks @EdAbati !

[MarcoGorelli]

@EdAbati is it possible to have most downstream tests run on every commit, but only the slow ones (for now, just vegafusion) only run before releases?

[EdAbati]

is it possible to have most downstream tests run on every commit

I will have a look today 👀