feat(ensemble_test_runner): add profile support for test execution an… - #2328
Open
sharjeelyunus wants to merge 9 commits into
Open
feat(ensemble_test_runner): add profile support for test execution an…#2328sharjeelyunus wants to merge 9 commits into
sharjeelyunus wants to merge 9 commits into
Conversation
…d configuration - Introduced `--profile` option in CLI for selecting test profiles. - Updated README to document the new profile selection feature. - Enhanced JSON schema to include profiles configuration. - Modified test discovery and execution logic to handle profiles. - Added support for profiles in test case definitions and configurations. - Updated HTML report to display profile information for test runs.
Contributor
|
Bugbot is not enabled for your account, so this pull request was not reviewed. Enable Bugbot in the Cursor dashboard to get automatic reviews on future PRs. |
- Added functionality to clean up parallel run artifacts, including screenshots. - Updated `cleanTransientArtifacts` to publish screenshots to the report directory. - Adjusted test cases to verify the new screenshot handling and reporting structure.
- Added support for deduplicating identical encoded screenshots in the contact sheet. - Introduced a new `ScreenshotHighlight` class to manage highlight information for screenshots. - Updated image encoding to support both PNG and JPEG formats with compression. - Enhanced HTML report generation to include screenshot highlights. - Modified test cases to validate the new screenshot handling and deduplication logic.
- Updated screenshot encoding to include WebP format alongside PNG and JPEG. - Introduced a new method to handle WebP encoding using the cwebp tool. - Enhanced the screenshot handling logic to select the smallest encoded image. - Modified tests to validate the inclusion of WebP files in the output.
- Added a new callback `onBeforeActionStep` to `TestStepExecutor` for pre-action handling. - Updated `_tap` method to invoke the new callback if provided. - Enhanced step formatting to support single nested optional steps in `formatStepBrief` and `outlineSteps`. - Introduced logic to capture screenshots for optional action steps during execution. - Modified tests to validate the new formatting and callback functionality.
…functionality - Implemented a new test to verify that the onBeforeActionStep callback is triggered before a tap action is executed. - Ensured the callback captures the correct step and state of the button tap during the test execution. - Enhanced the test suite to validate the interaction between the callback and the action step.
…e screenshot deduplication - Introduced a new callback `onAfterActionStep` in `TestStepExecutor` to allow actions after executing a test step. - Updated the execution flow to call `onAfterActionStep` after specific actions like entering and clearing text. - Enhanced screenshot handling by implementing visual deduplication for equivalent screenshots, reducing redundancy in reports. - Modified tests to validate the new callback functionality and visual deduplication logic.
…selection - Added `actionSettleTimeout` to `TestExecutionConfig` for customizable action settling duration. - Refactored `_settle` method calls in `TestStepExecutor` to use `_settleAfterAction` for improved action handling. - Introduced `exactIds` in `EnsembleTestSelection` to allow precise test selection. - Updated test execution planner to support exact ID filtering while maintaining session dependencies. - Enhanced CLI to accept `ensembleTestShardId` for better test sharding management. - Added tests to validate new selection features and sharding behavior.
…reporting - Removed the `_publishScreenshotsToReport` method to simplify the screenshot handling process. - Updated `cleanTransientArtifacts` to clarify that it only removes transient frame manifests while keeping report screenshots intact. - Adjusted screenshot writing logic to separate manifest and image directories, ensuring proper organization of report artifacts. - Modified tests to reflect changes in screenshot directory structure and verify the retention of report screenshots.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
…d configuration
--profileoption in CLI for selecting test profiles.Description
Related Issue
Type of Change
What Has Changed
How to Test
Screenshots / Videos
Checklist
flutter analyzeand addressed any new warningsflutter testand all tests pass