Currently, it is not possible to deploy a pr concurrently (only one allowed). We could fix that by using subdomains in combination with Azurite or something along the lines of that.

This issue lists Renovate updates and detected dependencies. Read the Dependency Dashboard docs to learn more.

Awaiting Schedule

These updates are awaiting their schedule. Click on a checkbox to get an update now.

• chore(deps): lock file maintenance

Open

These updates have all been created already. Click a checkbox below to force a retry/rebase of any.

• chore(deps): update angular packages (@angular-devkit/build-angular, @angular/animations, @angular/cli, @angular/common, @angular/compiler, @angular/compiler-cli, @angular/core, @angular/forms, @angular/platform-browser, @angular/platform-browser-dynamic, @angular/router)
• chore(deps): update dependency typescript to v5.4.5
• fix(deps): update dependency ajv to v8.13.0
• chore(deps): update test packages (major) (chai, supertest)
• Click on this checkbox to rebase all open PRs at once

Ignored or Blocked

These are blocked by an existing closed PR and will not be recreated unless you click a checkbox below.

• chore(deps): update dependency lit to v3
• chore(deps): update dependency microsoft.azure.webjobs.script.extensionsmetadatagenerator to v4
• chore(deps): update dependency vite to v5

Detected dependencies

• Check this box to trigger a request for Renovate to run again on this repository

This issue depends on stryker-mutator/mutation-testing-elements#2434

Realtime Reporting

Realtime reporting locally is doable, but it would also be nice to have this feature available in the Stryker dashboard.

Implementation

The implementation is potentially similar to the implementations found in the different Strykers, except that the dashboard should have an API endpoint available for pushing mutants to.

The flow will be like this:

1. Upload the initial state to the dashboard.
2. Accept a list of mutant "events" in the API endpoint (to reduce HTTP calls)
3. Using SSE, relay information to the browser and update the report.
4. When the mutation testing process is complete, send a call to a different endpoint.
5. Write the complete report disk (azure).

Question(s)

1. When sending mutant data to the dashboard API, should a Stryker tool send the data batched (i.e. wait for 1s and then do the request)?

I noticed some time ago that the badge-api service is not working (including the badge for this repository):

https://badge-api.stryker-mutator.io/github.com/stryker-mutator/stryker-dashboard/master produces 503: The service is unavailable.:

Lets start with some explanation on how end users can use the dashboard to add a badge to their repo.

When the version string does contain a "." the resulting report url does not work.

Example:
https://dashboard.stryker-mutator.io/reports/github.com/richardwerkman/stryker-net/my.test

It could be that the . causes the path to look like a file.

Rather return a http 200 + an 'unknown score' badge.

I want to link to dashboard of the default branch of my project.

I was hoping to use HEAD (https://badge-api.stryker-mutator.io/github.com/regseb/cronnor/HEAD or https://dashboard.stryker-mutator.io/reports/github.com/regseb/cronnor/HEAD), but it doesn't work. Is it possible to support HEAD?

I could use master, but if my default changes: I would have to change all links.

Is your feature request related to a problem? Please describe.
My current setup has ~1600 mutants across 9 files. To reduce mutation testing time (takes 12 hours total), I parallelize these in my GitHub workflow (slowest takes 6 hours). Some of these files are in the same folder eg. "App/App_functions.js" and "App/App_helpers.js". During mutation testing the natural module to make for both (in dashboard) is "App", but since they end at different times, one overwrites the other.

Describe the solution you'd like
Specifying a module for dashboard reporter should not overwrite existing files in that module. Maybe include an additional config parameter like "overwriteModule: Boolean" so that the user can decide whether or not that is what they want.

Describe alternatives you've considered
I created different modules for each file, in total I had 9 unique modules for my 9 files - this is not ideal.

Additional context
When creating new modules, the old modules remain in the dashboard and there seems to be no way to clear/remove them so they end up interfering with the mutation score. It would be great if a feature for this was provided as well. Maybe add another config variable in the dashboard reporter that removes specific module names. Eg. "existingModules.names: string[]" // contains module names to consider
"existingModules.actions: {'overwrite', 'clear', 'remove'}" // what to do with these modules

It would be nice to be able to change the badge style, similar to what https://shields.io does.

• Visit https://badge.stryker-mutator.io/github.com/my/repo/5.0 go⬈
• Redirects to https://img.shields.io/endpoint?url=https%3A%2F%2Fbadge-api.stryker-mutator.io%2Fgithub.com%2Fmy%2Frepo%2F5

Notice the branch name has been truncated from 5.0 -> 5. Seems something is interpreting the path component as a number and simplifying it from a float to an int. Nasty.

I want to rename the module but can't seem to replace or remove the old one: https://dashboard.stryker-mutator.io/reports/github.com/riezebosch/CommandLiners/master

See the screenshot bellow where I was switching from infection to theofidry back and forth.

I think the result could be cached like in Travis with a default TTL and allow maybe an account page or button to force a new synchronization if ncessary.

Question

Does https://dashboard.stryker-mutator.io/ support private org repos? I can see my public repos but no way to authorise access to my private repos held under my enterprise?

Stryker environment

+-- @stryker-mutator/[email protected]
+-- @stryker-mutator/[email protected]

+-- [email protected]
+-- [email protected]
+-- [email protected]
+-- [email protected]
+-- [email protected]

Additional context

N/A

https://nodejs.org/en/blog/announcements/nodejs16-eol

When logging into the app with GitHub the Stryker dashboard requests access to read and write to all public and private repositories of the user. This doesn't seem necessary.

As an example, Coveralls, which is a somewhat similar type of app, requests the following permissions.

This is a link to the documentation on scopes:
https://developer.github.com/apps/building-oauth-apps/understanding-scopes-for-oauth-apps/#available-scopes
The scope "repo:status" can be used to give the app access to the commit statuses. I think this will allow you to show the mutation score for each commit without needing full access to the code of user's repositories.

When I remove a repository, the switch on the dashboard goes to the 'off' position:

However, when I refresh the page the repository is enabled again:

When I looked in the storage explorer, I noticed that the API key has was succesfully removed, but the project was still enabled:

When the repositorySlug does not exist such as by not prepending github.com/ to it (stryker-mutator/stryker4s#221) the dashboard reporter returns a 200 with a body of null (string). This is not very useful. If the dashboard were to return a 404, possibly with a message that the repositorySlug is not found, it would be clearer what went wrong

We should be able to use deploy the StrykerBadgeAPI using a pipeline

I was hoping to add the xmldom project from the xmldom org (https://github.com/xmldom) but for some reason the dashboard does not seem to see xmldom as one of my orgs. I am one of 3 shared owners of this org.

Thanks in advance!

We should not have to do this manually.

I don't think we should expect all mutation testing tools to provide the ability to track mutations. So with that in mind, maybe it would be worth to allow the ID to be optional and simply not show it when not available.

We would like to have a compare page. Comparable (pun unintended) to githubs compare feature.

The comparison would show the diff between 2 mutation testing reporters. Mutants that did not change (and the tests didn't change) could be shown as ignored (or not shown entirely). We can reuse internals from StrykerJS's "incremental mode" feature.

URL design could also be inspired by Github's design:

I.e /compare/github.com/stryker-mutator/stryker-js/master...feat/octocat compares master to feat/octocat.
I.e /compare/github.com/stryker-mutator/stryker-js/fix/bar...feat/foo compares fix/bar to feat/foo.

https://dashboard.stryker-mutator.io/ certificate has expired today : Expired Thursday, May 3, 2018 at 16:35:17 Central European Time (translate from french)

Maybe on the following homepage:

Some curated repositories could be displayed. I don't know if private/public repositories are displayed, but the repositories are public you could maybe list them on the homepage to show-case the dashboard.

Since one may not necessarily be featured on the homepage, I would have a setting allowing to disallow to be displayed on the homepage though (on a repository or organisation basis)

When disabling a repository, a previously uploaded report and badge are still available

Expected situation

When disabling a repository, the report and mutation score information are removed and no longer available

Actual situation

They are still available

Originally posted here infection/infection#1646

The main idea is to replace unpkg with more reliable CDN

@nicojs suggest the following infection/infection#1646 (comment)

Yeah unpkg isn't the most reliable CDN out there. Might be time to switch over to a locally served one, or include it in the JS bundle.
Feel free to open an issue at the dashboard GH repo

When trying to post to the API with an invalid report, it will show the stacktrace, we should probably fix that.

• Working:
  • https://github.com/CJDennis/hidden-value
  • https://github.com/CJDennis/rounding
• Not working:
  • https://github.com/CJDennis/mac-address
  • https://github.com/CJDennis/unit-test-compatibility

Plus more examples of each.

Why are some working and some not? I've set up each one the same way with its own key as I've activated it from the Stryker dashboard.

I think it would still not be super-obvious to newcomers that the "Mutation score" badge would link to the nice, valuable HTML report on the Stryker dashboard.

Please provide an option to delete a module from the Stryker dashboard, either via UI or at least via an API call.

Background:
I used stryker to analyse my projects (see Testably.Abstractions. Later on I removed the "Testably.Abstractions.Extensions" project, but the latest analysis is still present in the combined analysis for the main branch and also changed the total score for the Badge.
Note: the latest branch-specific analysis doesn't contain this project.

I already tried removing the repository and creating a new API key, but to no avail.

Maybe a combination of both could be done:

• Adding a search
• Sort repositories by type and then by name:
  • provider
  • repository enabled
  • source repository
  • fork

This would allow the list to be much more friendly when like me you have 152 repositories but only one enabled

Hello !

I am wondering if there are plans to support backends other than Azure Storage ?

We are considering using stryker-dashboard to store the result of mutation testing for our Typescript & Kotlin projects (report generated with pitest).
We would love to self-host a dashboard instance but we do not use Azure, we use AWS.

Cheers and thanks for a great product :) !

When I access to the dashboard logged in (e.g. https://dashboard.stryker-mutator.io/repos/theofidry) and click on the stryker icon top left, I get redirected to the following page:

And then it takes a solid 1-2 seconds before redirecting me to https://dashboard.stryker-mutator.io/repos/theofidry because I'm logged in

We should create a few ui tests for the front end

Does Stryker support private repositories? I can't seem to grant access to those when using the app?

GitHub has something called 'check-runs' they allow adding annotations to a 'check'. Checks are for example what GitHub Actions create. These annotations show up at a line of code. A good example is the eslint-action which lints code and displays error messages directly in GitHub. More info about checks can be found here or here. Annotations can be added to a new check created by the action, or an existing one that is currently running like the CI action. It looks a little like this:

We could add something similar to the Stryker Dashboard by adding a GitHub reporter. This reporter could annotate survived mutants at their position in the source code on GitHub so people can view their mutation testing results in GitHub. This would also work very well in combination with a diff-runner (not supported yet by Stryker4s). A score could also be reported at the end

Some things that need discussion:

• What should survived mutants be reported as? I don't think it should be an 'error' because then the user will always have a failed check unless they have a score of 100% which is the wrong message to send IMO
• Should we report other mutant statuses? It might become a little crowded if we report everything
• Another option would be a stryker-report-action that could be run after mutation testing. The action could read the JSON report and send the annotations. Upside is that it would work for all Strykers (or other mutation testing framework). Downside is it would not report the results in realtime, and would require the main CI to be in GitHub actions already (which wouldn't be required if the Stryker4s reporter creates a new check)
• Do we currently have enough information in the dashboard to make this API call
• Easiest way to do it would be when the framework sends the full report. Coolest way would be in a streaming fashion as results come in

Time for the next step: hosting mutation testing reports. We will use mutation-testing-elements for the json schema as well as the html report itself.

Suggestion for the new api:

HTTP POST https://dashboard.stryker-mutator.io/api/reports

{
  "apiKey": "61213121e3wdasdASD",
  "branch": "master",
  "mutationScore": 80,
  "repositorySlug": "github.com/stryker-mutator/stryker",
  "report": { "...": "..." }
}

We're requesting too many privileges. We shouldn't need "commit" access.

See also:
https://twitter.com/tfidry/status/1210651591918997508

Hi, I've been using stryker a lot and I've been adding the badges to every readme, it's great and encourages people to write good tests in there PRs!

I have a suggestion/feature request, for the codecov badge I don't need to set a key on travis-ci for any open source projects

Would it be possible to add a feature like this to the stryker dashboard?

Thanks! 😄

Summary

Thanks for the awesome tool!

My repo is a mono repo, I added Stryker to my api server folder at https://github.com/Hongbo-Miao/hongbomiao.com/blob/main/api/stryker.conf.js
Also, I added Stryker to my GitHub Actions pipeline, and it runs successfully.
https://github.com/Hongbo-Miao/hongbomiao.com/runs/2116804199?check_suite_focus=true

with log

...
22:31:43 (1715) INFO DashboardReporterClient PUT report to https://dashboard.stryker-mutator.io/api/reports/github.com/Hongbo-Miao/hongbomiao.com/PR-1972 (~976888 bytes)
22:31:43 (1715) INFO HtmlReporter Your report can be found at: file:///home/runner/work/hongbomiao.com/hongbomiao.com/api/reports/mutation/html/index.html
22:31:45 (1715) INFO DashboardReporter Report available at: https://dashboard.stryker-mutator.io/reports/github.com/Hongbo-Miao/hongbomiao.com/PR-1972
22:31:45 (1715) INFO MutationTestExecutor Done in 3 minutes 52 seconds.

You can see my pull request Stryker report

However, my badge is not working,

Also, my dashboard is also not working.
https://dashboard.stryker-mutator.io/reports/github.com/Hongbo-Miao/hongbomiao.com/main

Does this issue is related with mono repo?

(I am also planning to add Stryker to my web and mobile app in this mono repo in future.)

Stryker config

/**
 * @type {import('@stryker-mutator/api/core').StrykerOptions}
 */
module.exports = {
  packageManager: 'npm',
  reporters: ['html', 'clear-text', 'progress', 'dashboard'],
  testRunner: 'jest',
  coverageAnalysis: 'perTest',
};

Test runner Jest config

module.exports = {
  testEnvironment: 'node',
  testPathIgnorePatterns: ['<rootDir>/build'],
};

Stryker environment

 "@stryker-mutator/core": "4.5.1",
 "@stryker-mutator/jest-runner": "4.5.1",

"jest": "26.6.3",

Test runner environment

npm test

api/jest.config.js

Your Environment

Add stryker.log

N/A. The test did run successfully in the GitHub Actions build which can be found above.

Problem

For example, this is me switching between tabs 2 times:

Steps to reproduce

1. Visit the Dashboard.
2. Switch from mutant to test view.
3. Observe multiple requests in the developer console.

Misc

• Tested on Firefox and Edge (newest versions).
• It appears that on page load two of the same requests are executed.
• Also I noticed that this happens when the fragment gets updated (changed to gibberish: #bla123, does a request as well)

Solution

Only do the GET request once 👍.

potentially something in the Router:

We should improve logging in the azure function with context.log and context.log.error (not console.log or something else)

We need to create unit tests for the front end

https://dashboard.stryker-mutator.io/repos/brodybits - long scrollable list since I have over 400 forks

I think it would be nice for the UX to be more easily searchable and to keep enabled repos at the top.

I do keep a number of personal GitHub orgs to manage some of my work. I should probably clean up my forks and keep most of them in a personal GitHub org.

No direct link from https://dashboard.stryker-mutator.io

Starting from https://stryker-mutator.io I had to follow one link to the handbook on GitHub and then find dashboard.md.

I would really favor some kind of a direct link from https://dashboard.stryker-mutator.io.

TODO:

• Implement in stryker dashboard
• Implement in dashboard reporter Stryker
• Implement in dashboard reporter Stryker.NET
• Implement in dashboard reporter Stryker4s
• Advertise this in the dashboard

We should implement this in the different reporters behind a flag IMHO. Maybe people only want the mutation score badge and not the full report.