We have a repository with various examples that let you easily test or reproduce a specific feature. For more information about this check out the repository.
There aren't any restrictions on what examples to put in this repository. The idea is that whenever we need to test or reproduce something, we check if an example already exists and if not, then we think about whether it may be useful to add one to the above repository so others can reuse it in the future if we find ourselves building such a page anyway.
Regarding keeping them up to date: Since we mostly keep BC they shouldn't regress too much and if they do become outdated, that may be fine as we'd notice this when testing an example.
While we build new features or fix bugs (mostly tracking related) we build such pages often for ourselves anyway and the idea is to share these pages with the team so they can be reused in the future. There is no obligation to add such a page as part of building a feature although it would be great to do in some cases as it would be mostly needed anyway for the author of a new feature/bugfix as well as the tester.
If you can't reproduce an issue easily, then it may be useful to ask a user to provide the Matomo system report which will be anonymised automatically and it should be safe to share in a GitHub comment. Alternatively, this could be posted to us by email.
As a developer it may be useful to generate test data. To do this, follow these steps:
VisitorGenerator plugin via the Marketplace if needed./console visitorgenerator:generate-websites --limit=50./console visitorgenerator:generate-users --limit=50./console visitorgenerator:generate-goals --idsite=1./console visitorgenerator:generate-visits --idsite=1./console core:archive