AI for Test Coverage, Why Playwright is Slow, Crowdstrike and more!

Do you know how much of real production usage your tests cover?

Why is slowing down your Playwright tests?

What are some key testing lessons you can learn from the Recent Microsoft/CrowdStrike incident

Find out in this edition of the Test Guild New Shows Newsletter for the week of July 21 So, grab your favorite cup of coffee or tea, and let's do this.

Analysis Reveals Gaps in Test Coverage for Software Testers

A recent blog post highlights a critical issue regarding test coverage in software development. It suggests that many software teams may not know how much of their real production usage is actually covered by their test suites, despite having a large number of tests, such as 5000. This gap in understanding can lead to undetected issues and potential system failures.

If that is, you listen up!

I just learned about InfiniSights which is a new complementary capability that Infinitest.io has recently added to the existing record and playback solution. InfiniSights generates insights based on the data that is collected by the Infinitest’s agent.

InfiniSights generates two types of AWESOME insights:

1. Events - Showing how many of unique user's events exist in your tests, and which are missing.
2. Flows - Showing the most common user journeys (generated by Infinitest’s proprietary algorithms) and how many of them are part of your tests.

With these two insights you can simultaneously see what your current test coverage is and what is missing - based on the most current and common users' actions!

Sounds awesome – right?

Check it out for yourself now by heading over to ?????? testguild.me/testcover and increase your test coverage now.

Are your Playwright Test Slow??

In recent findings, developers have identified that the use of ?? page.goto() in Playwright tests is contributing to slower test execution times. Playwright, a popular open-source framework for end-to-end testing, allows for efficient web testing across different browsers. However, the "page.goto()" function, which navigates to a specified URL, has been pinpointed as a performance bottleneck. This slows down tests as it waits for the entire page load, including resources, before completing.

So just be mindful that repeatedly using "page.goto()" in your Playwright scripts might be causing significant delays.

To optimize test performance, testers can look for alternative methods such as using selective waits for specific elements or conditions required for their test scenarios, rather than waiting for the full-page load. Implementing this can lead to markedly faster test execution.

Follow the money segment What Company was just Acquired for 150 million?

Tricentis, has announced the acquisition of the AI-powered continuous testing platform, ??SeaLights, for $150 million. This strategic move aims to enhance Tricentis' test automation capabilities. The deal reflects Tricentis’ commitment to expanding its AI-driven testing solutions, targeting improved efficiency and comprehensive coverage for software development lifecycle.

The acquisition underscores the growing importance of AI in the software testing industry. Testers should focus on familiarizing themselves with AI and continuous testing technologies. A significant insight is that expertise in AI-based testing tools can offer a competitive edge in the evolving landscape of software development and testing.

One of the last things I did before I was laid off almost 5 years ago was do a proof of concept for using AI to identify test to run for code check-ins and Sealights was selected. So really excited for folks like co-founder Eran Sher who has been on my podcast multiple times and everyone else on the Sealights team.

Webinar of the Week

Salesforce offers endless customization possibilities. But how can you keep up with testing to ensure that your customizations actually work?

That’s why I'm excited about our upcoming webinar that introduces an awesome solution: an AI test engineer that autonomously creates and maintains test scripts, including multilingual support. This simplifies the creation of test automation scripts, enabling even non-coders to efficiently handle testing with multilingual support.

Join us for a live demo where the AI test engineer will showcase its capabilities directly on Salesforce.

Register now to learn more about:

• How AI can automate the creation and ongoing maintenance of test scripts, significantly reducing the technical skill required.
• The advantages of multilingual support in testing, ensuring that customizations work across different language interfaces.
• Best practices for integrating AI testing into your Salesforce development cycle to enhance efficiency and reliability.
• Insights into how autonomous testing can accelerate your deployment cycles and reduce downtime.

Check it out at ?????? https://testguild.me/aisales and hope to see you there!

Latest Cypress Release?

CypressIO has introduced ?? version 13.12.0 of its testing tool. The update includes enhanced features and improved performance. The new version focuses on stability improvements, making automated testing more efficient for developers. Some key features are support for Angular 18 Component Testing support to Signal support for Angular Component Testing (v17.2+).

?Testers should upgrade to Cypress v13.12.0 to benefit from enhanced stability and explore newly added features to streamline their testing processes.

DevAssure

I came across a new tool I never heard of that I thought you would want to know more about as well.

This is from George Ukkuru who mentioned on LinkedIn that he discovered a tool called ??DevAssure. It uses Gen-AI to generate test cases from UI mockups and feature specs, integrating seamlessly with popular tools like Figma. The AI-powered code analyzer identifies functional bugs early, and the codeless test IDE facilitates automated tests. DevAssure also includes built-in Visual Regression and Accessibility testing.

AI-Focused Engineering

What’s Required to Support an AI-Focused Engineering Team?

As AI technology continues to grow, supporting an ?? AI-focused engineering team requires a blend of specialized skills, collaborative tools, and robust infrastructure. Companies need to invest in hiring individuals proficient in machine learning, data science, and software development. Equally important is the establishment of a collaborative environment that encourages knowledge sharing and continuous learning.

Additionally, strong computational resources, such as high-performance GPUs and cloud services, are crucial to handle intensive AI processes. It's essential for teams to have access to large datasets and advanced analytics tools to facilitate accurate model training and validation.

As AI integration becomes more prevalent, testers should broaden their skill sets to include AI and machine learning concepts. Understanding these technologies will be vital in verifying AI-driven solutions effectively.

Continuous Web Performance Monitoring

In today’s performance testing news, industry expert Tammy Everts emphasized the significance of ??continuous web performance monitoring.

Writing on LinkedIn, Tammy highlighted how monitoring tools like SpeedCurve can offer real-time insights into website performance, enabling businesses to make timely improvements. She stressed that ongoing monitoring is crucial for maintaining optimal user experience, which directly impacts customer satisfaction and conversion rates.

Continuous web performance monitoring is essential for identifying and addressing performance issues promptly. Testers should integrate real-time monitoring tools to ensure websites remain fast and efficient.

To stay ahead, software testers should automate performance benchmarks and set up alerts for performance degradation, ensuring prompt action and minimal user disruption.

CrowdStrike

This is probably the biggest news last week and it was around CrowdStrike. There where multiple post about this. Here are a few key ones

In a recent blog post called ?? Software Stability Challenged by Fragile Systems, James Pulley James Pulley inspired by the CrowdStrike incident highlights the prevalence of fragile systems in our digital universe. The post emphasizes that software systems, despite advancements, remain susceptible to failures. Complexity in design and unexpected interactions between components often lead to system breakdowns.

The key point I think James makes is that As CrowdStrike has demonstrated, we are only one software patch away from disaster on a scale not possible before in human history because of our high dependence on software-defined systems.

Lee Barnes wrote his thoughts around ?? drawing Lessons from the Incident

Instead of fixating on assigning fault let's explore how we can all glean lessons from this incident. Here are some actions that organizations, including CrowdStrike can implement to enhance software quality and reduce the likelihood of incidents:

• Strengthen Testing Procedures - Enhance deployment testing to encompass a broader range of scenarios and edge cases. Particularly focusing on this specific issue. This involves expanding test scope utilizing real world data and simulating customer environments, configurations and usage patterns.
• Embrace Secure Deployment Approaches - Incorporate deployment techniques like blue-green deployments to minimize downtime and ensure swift rollbacks if issues arise.
• Cultivate a Culture of Ongoing Improvement - Foster an environment of continuous improvement where insights from incidents prompt refinements, in processes, tools and methodologies. Regularly looking back and updating risk scenarios and QA strategies based on lessons learned is crucial.
• Cross Functional Collaboration - Promote collaboration among developers, testers and operations teams to prioritize quality in every phase of software development.
• Strengthen Monitoring and Response - Invest in monitoring systems to identify issues in real time and create a thorough incident response plan for quick resolution.

And Jason Arbon wrote about ?? Disappointing to see some testers take pleasure in the CrowdStrike issue today. Worse, some are leveraging it for self promotion and spreading FUD. But what is interesting about this post is ALL the awesome comments over 105 with all kinds of different opinions.

And last up in security news

Invicti, a provider of application security testing solutions, today announced Invicti API Security , merging comprehensive API discovery with proactive security testing into a single solution.

Why should you care well According a recentreport, 76% of organizations report having an average of 26 APIs per application deployed. Many of these APIs are undocumented and unmonitored, so the security challenge is now about confidently and quickly finding APIs, testing them for vulnerabilities, and performing remediation. With Invicti API Security, organizations can realize comprehensive API discovery alongside proactive API security testing.

That's a Wrap

So that's it for this Test Guild News Show Newsletter edition.

Make sure to ???? subscribe to never miss another episode.

I'm Joe Colantonio, and my mission is to help you succeed in creating end-to-end full-stack DevSecOps automation awesomeness.

As always, test everything and keep the good.

Cheers!

Next Steps

Are you a test tool provider or do you offer DevOps automation and testing solution or service? Partner with TestGuild to deliver real-world value and address the pressing challenges facing the testing community.

We’re eager to collaborate to elevate the skills within our guild and generate qualified leads for you.

Let’s make impactful strides together. ?????? Connect with us today!