Calypso AI
Nominated Award:
Best Application of AI in a Startup
Website of Company (or Linkedin profile of Person):
https://www.calypsoai.com/
CalypsoAI’s mission is to build trust in AI through independent testing and validation. We solve one of the biggest issues facing AI: machine learning models not getting deployed into production. Through CalypsoAI’s automated testing and validation solution, decision-makers gain the performance visibility needed to confidently deploy their models into production. This ensures the success of AI strategy while drastically reducing the amount of risk, time, and money spent manually testing and validating models.
Our product, VESPR Validate, enables governments to test their machine learning models for adversarial robustness, and performance against environmental corruptions such as weather and lighting.
Reason for Nomination:
AI testing and validation is a brand new space, and it will be imperative in order for governments and enterprises to develop the next generation of AI solutions. with a focus on confidence and ethics.
CalypsoAI’s VESPR Validate is the solution for trustworthy AI, bringing confidence, security, and speed to the AI deployment process. Pre-deployment testing through VESPR Validate provides a clear understanding of the bounds for AI system success, testing a model’s resilience against obstructions, corruptions, and attacks.
VESPR Validate currently focuses on supporting object detection models through the following capabilities:
Full Motion Video (FMV) testing: Test a video capture against the ML model, and receive results to identify the model’s weaknesses, such as misclassification or excluding particular details.
Visual corruptions: Apply corruptions to an image to understand where the model performs well and when it will return erroneous results. This process corrupts or modifies the testing data to add in fog or blurs, identifying the point at which the model starts to fail and to what degree it will fail.
Security testing: These tests help to determine if your sensitive model is secure, making it more difficult for adversaries to manipulate the model through an attack. The solution can also effectively test model vulnerability to image attacks, manipulating the visual data being interpreted.
Through these capabilities, model vulnerabilities are quickly identified, enabling stakeholders to make rapid decisions on deployment. VESPR Validate identifies where additional model training is needed and guides MLops teams in their missions to efficiently develop and deploy models built to withstand obstructions, errors, and more.
AI trust means having confidence that deployed systems are performing as intended with security and speed. VESPR Validate is an essential tool in this mission to build trust in AI.
Additional Information:
AI is one of the defining technologies of the 21st century, and it is critical for democratic governments to embrace it while still emphasizing ethics and values in order to compete with authoritarian governments developing AI for their own means. Independent testing and validation through CalypsoAI can be a key driver in this AI race, enabling governments to deploy more innovative AI while maintaining confidence that it will perform as intended.