Lots of issues with Travis CI feature velocity as well. Most of the other pain points others have mentioned I have felt. Random build failures, network issues, and etc.
A particular issue is the PR merge-commit builds. Between stages a merge/push into master can change the merge-commit! This means code between stages can diverge. You may build an artifact in one stage, then run an out-of-date test suite against it in another. Known issue for years, had an employee acknowledge months ago on the community forum then.. Nothing.
Another pain point that is not unique to Travis, is the lack of true "pipelines". Inter-project builds are a complete DIY crap fest. Coupled with roll-your-own artifact storage and retrieval.. Self-hosted solutions like Bamboo and TeamCity(Bamboos superior IMHO) are light years ahead of the SaaS solutions I've viewed.
Test report analysis is another big feature missing from most. Would be good to be able to visualize and report on tests. I was almost considering this being a valid stand-alone SaaS idea because nobody has it!
I believe the future of our integration/system tests will be build on codepipelines or the like for scale. Travis or CircleCI will be the public facing component.
A particular issue is the PR merge-commit builds. Between stages a merge/push into master can change the merge-commit! This means code between stages can diverge. You may build an artifact in one stage, then run an out-of-date test suite against it in another. Known issue for years, had an employee acknowledge months ago on the community forum then.. Nothing.
Another pain point that is not unique to Travis, is the lack of true "pipelines". Inter-project builds are a complete DIY crap fest. Coupled with roll-your-own artifact storage and retrieval.. Self-hosted solutions like Bamboo and TeamCity(Bamboos superior IMHO) are light years ahead of the SaaS solutions I've viewed.
Test report analysis is another big feature missing from most. Would be good to be able to visualize and report on tests. I was almost considering this being a valid stand-alone SaaS idea because nobody has it!
I believe the future of our integration/system tests will be build on codepipelines or the like for scale. Travis or CircleCI will be the public facing component.