Welcome to the 180th issue!

One of the inevitably important topics in software testing right now is how to test AI.

So today, I want to share with you some exciting resources I found recently.

The first one is Testing Language Models (and Prompts) Like We Test Software by Marco Túlio Ribeiro and Scott Lundberg.

It's a super deep dive into evaluating different testing methods that may apply to AI, based on two research papers they authored:

• Beyond Accuracy: Behavioral Testing of NLP Models with CheckList
• Adaptive Testing and Debugging of NLP Models

Finally, I want to highlight a recent article by Jason Arbon, showing a simple example of Testing AI with AI.

Happy testing! 🙂

Dawid Dylowicz  

Calling all Software Testers and QA Leaders! Register for <break>point 2023 by BrowserStack

Heisengbugs, Higgs Bugsons, Hindenbugs… sometimes, there's no telling when the next one is around the corner. Although, you can better prepare yourself by tuning in to BrowserStack's free, virtual flagship event, <break>point 2023, from August 8th to 9th. You'll hear from tech experts who'll help you up your software testing game in the time it takes to watch a movie. Register for free!

browserstack.com  

Achieving Quality And Speed: Tips For QA Leaders In Delivering Exceptional Products

What does it take to be a great leader in software testing? Konstantinos Konstantakopoulos gives good advice based on his experience.

Additionally, it's worth reading Jesper Ottosen's short reminder: Quality to Whom?.

ministryoftesting.com  

Find bugs before your users do: closing the software development risk exposure gap

Dane Hillard explains how putting several quality gates in the software development process can help mitigate the risk of shipping faulty products to customers.

In relation to that, Lesia Topol wrote a solid guide to rolling out a Regression strategy in one go.

medium.com  

How I Conduct an Accessibility Audit

While accessibility requirements are becoming more important, it's worth learning how to test for it. Here's some practical advice from Tyler Hawkins.

Also, Jesper Ottosen says that there might be More Than a Functional/Non-Functional Split.

dev.to  

Is blame game common in QA?

It's easy to point fingers at testers when something goes wrong. But it shouldn't be this way. This Reddit thread is full of comments from people sharing their experiences and advice.

And to mitigate that, teams should try Unveiling the Tester's Mindset: Secrets Developers Don't Fully Grasp.

reddit.com  

Testing Success: Why You Need a Test Architect in Your Corner!

What's the test architect's role about? And do you need one? Xavier Escudero Sabadell explains and shares his opinion.

medium.com  

API Testing 101: A Beginner's Guide to Testing Nodejs APIs with Jest and Supertest

If you want to learn API testing from the practical side, Hayatudeen Abdulrahman wrote a getting-started guide with a lot of code examples in JavaScript using Jest and Supertest.

Similarly, Aditya Bisht also wrote a full-of-examples tutorial of Testing in Nodejs with Jest and Supertest.

hashnode.dev  

Contract Testing: Navigating Through Common Pitfalls

Contract testing is often a good strategy for checking interactions between services. However, there are some pitfalls that you may want to avoid, as Wessel Braakman explains.

medium.com  

Mobile Apps Traceability

Javier Caballero shares a comprehensive overview of the synchronisation process for achieving the feature and test coverage when the mobile app and tests are in separate repositories.

medium.com  

What you should know about fault scenarios

Lucas Silveira explains the system design fundamentals and describes several practices for mitigating failure scenarios.

Additionally, Pablo Chacin also advocates for Democratizing Chaos Engineering with Fault Injection Testing.

medium.com  

Why Ruby is the Best Scripting Language for End-to-End Test Automation?

In this thorough, 13-point overview, Zhimin Zhan explains why Ruby might be a preferred language for test automation.

substack.com  

Github Copilot for Quality Engineers

How can Gthub Copilot help you with test automation? Bhabani Prasad Swain describes a few advantages.

medium.com  

Modern Web Testing with Playwright

This is a great overview of the modern testing goals by Andrew Knight, explaining how tools such as Playwright can help you achieve them.

And if you want to learn more about it, Malith Senadheera wrote a useful Playwright 101: Beginner's Guide.

automationpanda.com  

NightwatchJS for Browser Mobile testing

If you want to test web apps on mobile, Daniel Maioni has a comprehensive step-by-step guide to Nightwatch and Appium.

And speaking of browsers, Ravindra Yadav delves into Understanding 'Chrome For Testing': A Paradigm Shift in Testing.

medium.com  

Playwright stories: Network interception and why you may want to use it

If you want to make the best out of your Playwright tests, here's a handy guide by Kostiantyn Teltov to leveraging the network interception feature.

Moreover, João Coelho explains how to properly do Visual Regression Testing using Playwright.

medium.com  

Shrink The Time Gap: How a Cypress test can confirm there are no unexpected elements

Gleb Bahmutov demonstrates how to implement a smart assertion for dynamic elements that change state over time. Great advice, not only for Cypress users.

glebbahmutov.com  

Software Testing Ecosystem Mind

This is a great attempt by Anshita Bhasin to capture the software testing toolset ecosystem in one big mind map. While not exhaustive, it's a helpful resource when exploring tools in each area.

On that note, Parthiban Rajasekaran wrote a nice guide to ReportPortal — Embracing AI-Powered Transparency in Agile Testing.

medium.com  

Easy fix... 😂

Thanks for reading!

If you like this newsletter and it helps you become a better tester, you can say thanks and buy me a coffee.

Dawid Dylowicz