BLOG
WE SHARE OUR KNOWLEDGE
Challenges in implementing test automation
We conducted a research about implementing test automation within the organizations. Read this blog to learn about the key findings.
The software has changed dramatically from small programs to complex comprehensive IT systems over the last decade. Our lives are increasingly determined by its presence everywhere – right from our toothbrush to our cars. The quality of the software, therefore, stands to be of crucial importance. Organizations, which rely on manual testing methods, have to deal with an increasing pressure on faster time-to-market cycles. Software testers have to work iteratively to ensure the product continues to work even when there are multiple deliveries, resulting in tremendous pressure on the test process. This is where test automation plays an important role.
We conducted research about implementing test automation within the organizations. Based on this research we see that the organizations start enthusiastically with the implementation of test automation, but as time progresses, the enthusiasm decreases and the organization ceases.
Research approach
We examined 17 different projects regarding the implementation of test automation within test and QA organizations of different companies in the Netherlands. As a research method, we used semi-structured interviews. In this case study, the Test Automation Consultants (TACs) who implement or work with test automation were interviewed. This research focused on the question: “What are the positive experiences and challenges with Test Automation within the different organizations in the long run?” Thus, what has happened with the efforts from the past, and what are the changes the test automation will keep running after that one consultant leaves.
Based on interviews, we had positive experiences but faced challenges regarding test automation. The chart below lists the positive experiences and challenges.
Key results of the research:
- There was only one successful application of test automation, which is not a lot and means that test automation needs work, hard work.
- Test automation is started using a project-based approach in various organizations, where the organization and the test professionals are enthusiastic about automating current tests on different levels from a unit to a Graphical User Interface (GUI). The first projects are started successfully, and the agreed deliverables are delivered. The test professionals who are to work with the delivered tool or framework are trained. After the implementations of the tools, some challenges arise, such as maintenance on test scripts or code. This is due to the fact that not all test professionals have the skills to be able to do the maintenance of the test scripts or code. The organizations, however, keep trying test automation and see it as continuous improvement. In an ideal scenario, all the three wheels (as shown in the figure below) need to turn, to have continuous improvement within the organization.
- Most test professionals hired by an organization are outsourced. Thus, test automation remains dependent on individuals or external parties. Transferring the knowledge to the rest of the organization, therefore, becomes a challenge.
- It was also noticeable that not all organizations have a specific test strategy or architecture when implementing test automation. The organizations focus more on automating test scripts instead of thinking of an overall test strategy or architecture for the organization. This results in using tools that do not align with the other tools within the architecture of the organization. And worse – we start testing the wrong things.
The next practical recommendations are based on this research to help the QA & Testing professionals further with test automation.
- Start with the WHAT. What do you want to test and by whom?
- Identify in this the regressions and routine tasks, which can be automated by using test automation tools.
- Maintenance of your test automation is part of your test architecture.
- Make sure that you are doing enough unit testing to avoid finding defects on higher levels.
- Is there enough knowledge regarding test automation within the organization?
- Use it often in your tests to overcome the maintenance bottlenecks.
The learning points from the past are till valid for many organizations.
We know it is not easy to do test automation, however, it is important to have a closer look at your organization and decide what makes sense.
Ethics of Artificial Intelligence
Nowadays, Information Technology is present everywhere. Our lives are increasingly shaped and influenced by it. These developments can be observed across various sectors. Our systems, devices, cars, and equipment operate based on our input, and when issues arise, it is humans who resolve them. But what if our devices could think for themselves and solve problems autonomously? This is where Artificial Intelligence (AI) comes into play.The idea behind AI is to mimic human cognitive abilities. It should enable systems to make independent decisions based on triggers from their environment. The underlying concept of AI is that a system learns to make decisions autonomously by recognising patterns and following algorithms. This means that systems make mistakes and learn from them to become more effective over time. In a way, it resembles an educational or learning mechanism—commonly referred to as Machine Learning.On social media, algorithms are used to make recommendations for videos, advertisements, and other content. While AI can offer significant benefits to humanity, it also poses risks. Because AI systems can make mistakes, these errors may have serious or even fatal consequences in certain situations. Therefore, the legal and ethical frameworks surrounding AI are extremely important. The key dilemma of AI lies in the extent to which we allow our lives to be shaped and influenced by it.
Cybersecurity: From a technical issue to a strategic theme
Tot Until a few years ago, information security in many organisations was seen as the responsibility of the IT department. Firewalls in place, antivirus installed, and that was it. Those days are now long gone. Digitalisation, cloud solutions, chain collaboration, and hybrid working have made organisations more agile, but also more vulnerable. As a result, cybersecurity has evolved into a strategic theme that directly affects continuity, reputation, and trust.
At Continuous Connect, we see on a daily basis that cyber incidents no longer affect only large multinationals. Medium-sized organisations and (semi-)public institutions in particular are increasingly confronted with phishing, ransomware, or data breaches. Not because they are “careless,” but because their digital dependency has grown rapidly, while the organisation of information security has not kept pace or has only been put in place to a limited extent.
The reality behind cyber threats
Cyberattacks today are rarely spectacular. They often start small: an apparently harmless email, a reused password, or a supplier with insufficient security measures. The consequences, however, can be significant. Systems fail, service delivery comes under pressure, and executives are confronted with critical questions from supervisors, chain partners, and customers. Cybersecurity therefore is not only about technology, but above all about choices, priorities, and governance responsibility.
Guidance through models and frameworks
To bring structure to this complex landscape, many organisations make use of recognised frameworks and standards. In practice, we regularly see two models being applied.
De ISO/IEC 27001 provides a solid foundation for systematically organising information security. Not by locking everything down, but by placing risks at the centre and translating them into policies, measures, and continuous improvement. Organisations that work with ISO 27001 thereby create demonstrable control and clarity.
The NIST Cybersecurity Framework is often used as a practical growth model. Its five core functions—identify, protect, detect, respond, and recover—make cybersecurity accessible to both IT and management. The framework helps organisations gradually increase their maturity without becoming bogged down in technical details.
In practice, these frameworks complement each other well. Where ISO 27001 supports governance and assurance, NIST provides a recognisable and practical narrative for day-to-day operations..
Cybersecurity starts with awareness
What well-secured organisations have in common is not necessarily the most advanced technology, but a shared sense of awareness. Employees understand why information security matters, managers visibly take ownership, and executives ask the right questions. Cybersecurity then becomes not a barrier to innovation, but a prerequisite for safe and responsible growth.
Small steps, big impact
An effective approach does not have to be large or complex. Start by gaining insight into what is truly critical for the organisation, actively involve management, and work from a clear framework. Practise incident and crisis scenarios, evaluate (near) incidents, and continue to improve. Cyber threats are constantly evolving, and a resilient organisation evolves with them.