Top testing challenges | Agilitest blog

Testing is constantly changing. With these changes, come new challenges that testers must face. ‘Unfortunately’, testing, the software industry, and even our society are changing so fast that new challenges are coming up while existing challenges are not yet fully resolved.

Today’s testers are faced with both historical and current challenges. As for tomorrow’s testers, they will probably have to face the same challenges as today’s testers, while welcoming new challenges that we are starting to see coming.

In this article, I will share a selection of challenges that are, in my opinion, the main testing challenges of today and tomorrow.

The historical testing challenges

The place of testing and the tester

From this point of view, the way has been done. Nevertheless, this is only the beginning and there is still a long way to go to make people accept the tester, his interventions, but also the fact that testing is not exclusively reserved to testers. I have noticed name changes to designate the tester’s job. QA or QE to name a few. Indeed, in addition to conveying a positive image, these changes avoid a shortcut too often made: ‘testing is for testers’. Testing is a measure of quality, and quality is everyone’s responsibility!

Test automation

Since then, the tools have evolved considerably. They are more accessible, more powerful, easier to use, ‘cross-technology’… and some tools rely on AI to facilitate this automation. Nevertheless, test automation is still struggling to become widespread. The most common reasons are numerous:

  • Lack of time,
  • Lack of automation skills,
  • Lack of resources.

Even if these reasons can be true, they are not the only ones. Other reasons have emerged:

  • Methodology issues to initiate automation,
  • Ever-changing software and technology,
  • Environmental and data issues,
  • The desire to automate primarily (or even only) GUI tests when it is often simpler and faster to automate lower-level tests such as API tests.

Finally, automation does not only mean automation of test execution, but also automation of other activities such as reporting, design, environment and data management.

Training for the test

WQR 2022–23

However, I see very few training courses to become a tester, whereas there are many more to become a developer. It is therefore urgent for universities and schools to offer dedicated courses, as the institutions of the QTL Sup association do: https://qtl-sup.fr/

Post high school traning is important but not sufficient for several reasons. The two main ones are the time required for training and the evolution of practices. To answer the second problem, there are currently different training courses, the main ones represented are the ISTQB courses. There are also retraining courses that are working better and better and, in my opinion, we must continue to work in this direction… while offering more operational training courses that do not necessarily rely on specific tools.

Current testing challenges

Adapting to Agile

In order to answer this problem, the tester must have communication, listening, coaching, accompanying, questioning skills, while remaining curious. Integrating an Agile team in a human way is not easy. An Agile tester, as a member of the team, must make himself as useful as possible in this team. This will lead to an increase in skills/knowledge on various subjects that can be very technical or very functional.

For the moment, I have only talked about the tester’s adaptation to Agile, but the test must also adapt itself: more frequent execution, product vision and not Agile, multidisciplinary teams… In the end, we could almost say that in Agile, we must test more (in terms of frequency and scope), better… and in less time.

Technical and functional skills (API, BDD, data)

This multiplicity of needs also requires a multiplicity of skills, which is moreover complex to have all in one person. This is why more and more presentations on QE engineering are emerging. Where competences in a team and thus complementarity between its different members are sought. This does not exclude the need to increase competence in different skills; quite the contrary. However, this arrangement has the advantage of facilitating the development of skills within the team with collaborative practices in pairs between learners and experts.

Environments and data

This is no longer the case with Agile. The environments required are often more numerous. In fact, the data must be present, coherent and make it possible to ensure the validity of what is being tested. In the same way, developments must respect standards such as the GDPR (with, for example, the use of anonymized data), which greatly reinforces the challenges related to data and environments.

The CI/CD

Continuous integration is a process that validates the code modifications or evolutions made by the developer to respect a certain level of quality. It takes place at the time of branch mergers (‘merges’) when the developer integrates his code into the ‘common’ code. At this stage, many tests are performed. They generally include a static analysis (with Sonar-type tools) and unit tests. However, it is possible to add some automated functional tests, to make sure it does not slow down the process too much. It is therefore important for testers to find the right balance between selecting tests with a sufficient level of quality and respecting productivity with non-time-consuming tests. Even when automated, test execution takes time.

Continuous deployment goes further than continuous integration, because the goal is no longer to deliver in test but in production. The constraints remain the same as for continuous integration (even if the time constraint is a little less strong) but the quality requirement goes beyond simple functionality. It is therefore essential to think about the non-functional, with the integration, for example, of performance, security, accessibility tests or any other significant criteria.

Future testing challenges

Testing AI

Read full article on Agilitest’ blog. An article by Marc Hage Chahine.

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store