[Puts Testing Manager hat on..]
On Fri, Oct 9, 2015 at 5:05 PM, Louis Dionne
Hi,
With the goal of shipping Hana with the next release of Boost, I am currently trying to satisfy the requirement that Hana's testing results show up in the Boost regression matrix. One way to achieve this would be to have Travis CI upload the results on each push to master.
To do so, I would need to somehow create an XML file compatible with what the regression matrix expects. That brings up a few questions:
(1) Is there a way to upload the result of CMake tests to the Boost regression matrix? I suspect something like that might have already been done as part of the (unfortunately defunct) CMake effort?
There is no way, currently. (2) If not, would it be difficult to implement?
It would be difficult. As it would require dealing with it at almost every level of the testing process. Any input on how to best integrate Hana's testing results with the rest of
Boost's regression testing will be greatly appreciated.
As others have mentioned. You need to support Boost Build for integration into the rest of Boost. And that's not just testing. But it could also mean documentation and release/distribution. Also, before someone suggests using Boost.Build: I have been looking at the
possibility of maintaining a separate Jamfile. However, the need to maintain two separate build systems is annoying, so I'd like to avoid it if possible.
Can't be avoided.. But, if it's any consolation, I'm fairly certain that the Jamfile is going to be considerably smaller than the cmakelists.txt you have now.
I also think that Travis-based testing could provide a better coverage for Hana than the voluntary testers given the need for cutting edge compilers, but I could be wrong.
As a user of Travis myself, I can say you are wrong. Travis support for C++ testing is minimal. And you have to go through extra lengths to get any cutting edge compilers. And Travis will never have what Boost testing some times has.. Pre-release proprietary compilers from vendors on non-Unix platforms. -- -- Rene Rivera -- Grafik - Don't Assume Anything -- Robot Dreams - http://robot-dreams.net -- rrivera/acm.org (msn) - grafikrobot/aim,yahoo,skype,efnet,gmail