❌

Normal view

  • βœ‡InfoQ
  • Presentation: From AI Agent Demo to Production: Automated Testing and Evaluation Zhou Yu
    Zhou Yu discusses why AI agents stall in demo phase and shares how simulation-driven testing solves compliance and reliability bottlenecks. Learn how Columbia and Arklex AI use synthetic user personas, trajectory entropy, and automated CI/CD pipelines to evaluate multi-turn agents, catch edge cases before deployment, and scale self-learning workflows in production. By Zhou Yu
     

Presentation: From AI Agent Demo to Production: Automated Testing and Evaluation

7 September 2026 at 19:00

Zhou Yu discusses why AI agents stall in demo phase and shares how simulation-driven testing solves compliance and reliability bottlenecks. Learn how Columbia and Arklex AI use synthetic user personas, trajectory entropy, and automated CI/CD pipelines to evaluate multi-turn agents, catch edge cases before deployment, and scale self-learning workflows in production.

By Zhou Yu
  • βœ‡InfoQ
  • Article: A Better Alternative to Reducing CI Regression Test Suite Sizes James Bornefelt Westfall
    How can you focus in a sea of results from a large regression test suite? This article describes a stochastic approach that relies on some degree of redundancy in your CI regression test set. This approach does not guarantee you will catch every bug every time, but it gives you your best bet of not missing the subtle signatures of all the bugs uncovered by your CI regression test suite runs. By James Bornefelt Westfall
     

Article: A Better Alternative to Reducing CI Regression Test Suite Sizes

6 April 2026 at 19:00

How can you focus in a sea of results from a large regression test suite? This article describes a stochastic approach that relies on some degree of redundancy in your CI regression test set. This approach does not guarantee you will catch every bug every time, but it gives you your best bet of not missing the subtle signatures of all the bugs uncovered by your CI regression test suite runs.

By James Bornefelt Westfall
❌