Edit

Share via


Power Apps Test Engine overview (deprecated)

Note

Test Engine is deprecated and will be removed in a future release. Use Power Platform Playwright samples for test automation capabilities in Power Platform and Dynamics 365 services.

Power Apps Test Engine is a testing solution designed specifically for Power Platform applications. Whether you're new to automated testing, familiar with Test Studio, or an experienced developer with Playwright knowledge, Test Engine offers a scalable approach to testing that aligns with the low-code philosophy of Power Platform.

Learn more about how Test Engine helps you regardless of where you're starting from:

If you're testing your Power Platform applications manually, Test Engine provides an accessible entry point to test automation:

  • Low-code approach: Create automated tests using YAML and Power Fx, the same formula language used in Power Apps
  • No DOM knowledge required: You don't need to understand HTML or CSS selectors to interact with your app's components
  • Familiar terminology: Tests reference control names as they appear in Power Apps Studio, making tests easy to read and maintain

Test Engine can help you:

  • Save time: Automate repetitive test scenarios that you're currently performing manually
  • Increase coverage: Run more comprehensive tests more frequently
  • Create a test baseline: Document your testing process in a format that can be reused and shared
  • Learn gradually: Start with simple tests and expand as your comfort level increases

Currently, Power Apps Test Engine works with the following Power Platform components:

You must Install Microsoft Power Platform CLI to use the Test Engine.

Getting Started with Test Engine

The approach to getting started depends on your role and experience level:

  1. Install the Tools:

  2. Start with a Simple Test:

    • Begin with a basic test that validates a single screen or function
    • Use the YAML format to structure your test
    • Learn common Power Fx functions for testing
  3. Build Your Testing Skills:

Key features and benefits

Power Apps Test Engine provides a comprehensive set of features to support robust, low-code, and professional-grade testing for Power Platform solutions. The following highlights showcase how Test Engine can help you automate, validate, and maintain quality across your Power Platform applications.

End-to-end integration testing

Each of the following features are designed to help you achieve end-to-end integration testing across your Power Platform solutions:

  • Comprehensive Power Platform Coverage: Test your entire solution with integrated testing for Canvas apps, Model-driven apps, and Dataverse
  • Realistic User Journey Testing: Validate complete business processes across multiple Power Platform components, ensuring your solutions work as expected for real users
  • Simplified Environment Setup: Use the same authentication context across your entire test suite, reducing setup complexity and maintenance overhead

Natural language and AI-powered testing

Each of the following features are designed to help you achieve Natural language and AI-powered integration testing across your Power Platform solutions:

  • Copilot-Generated Tests: Create tests using natural language - describe what you want to test, and let Copilot help generate the test code
  • Natural Language and Generative AI-Powered Testing: Create test plans in natural language and convert them to executable tests using Generative AI capabilities
  • AI Result Validation: Confidently test AI-powered features with specialized functions that handle nondeterministic AI outputs
  • Human-Readable Test Plans: Write and maintain tests that business users and developers can both understand and contribute to
  • AI-Assisted Test Authoring: Use GitHub Copilot to accelerate test creation with source-controlled solutions

Power Fx test authoring

Using Power Fx as the text authoring language provides the following benefits:

  • Familiar Formula Language: Write tests using the same Power Fx language you already know from building canvas apps
  • Low Learning Curve: Use your existing Power Platform skills to create tests without learning complex testing frameworks
  • Control Name References: Reference app controls by their studio names rather than having to learn complex DOM selectors

Enterprise-ready testing infrastructure

Enterprise customers require robust features to manage authentication securely. Test engine provides:

  • Authentication Flexibility: Support for interactive login, service principal, and session persistence to fit your security requirements
  • ALM Integration: Seamlessly integrate with Azure DevOps, GitHub Actions, and other CI/CD pipelines for automated testing
  • MFA Support: Run automated tests in environments that enforce multifactor authentication without compromises

Advanced testing capabilities

These are advanced capabilities that Test engine provides:

  • Connector Mocking: Create reliable tests by simulating connector responses, even for paid or external services
  • Data Isolation: Test with predictable data conditions without impacting production environments
  • Visual Diagnostics: Troubleshoot test failures with automatic screenshots and video recordings

Limitations

As Test Engine is in preview, be aware of these current limitations:

  • Browser locale settings follow your default browser settings
  • Some specialized controls can require using the Preview.PlaywrightAction function
  • Performance testing capabilities are still in development

Supported browsers

The Test Engine works with the following browsers:

  • Chromium (Chrome, Microsoft Edge)
  • Firefox
  • WebKit (Safari)

Next Steps

Explore Test Engine Features