Automated Testing of an Access Point with Real Devices
Managing 100+ real devices, conducting both basic and advanced tests, and gathering the data results is not easy. It's a complex and resource-intensive task that requires careful planning and significant resources. Challenges include device management, test execution, data gathering, infrastructure scalability and team expertise.
Let me introduce you to a solution called “LANforge Interop”, a software application that simplifies the process. It enables real-time monitoring of Wi-Fi statistics, manages all the 100+ Real devices, runs traffic tests, and generates comprehensive automated reports.
LANforge Interop can be effortlessly installed on end-user devices and empowers the test server to control these devices for a wide range of testing scenarios. This endpoint application is compatible with various operating systems, including Android, Linux, Windows, and macOS.
One of the standout features of LANforge Interop is it offers a suite of automated test cases, simplifying the process by allowing us to initiate tests with a single click and automatically generate detailed reports based on the gathered data.
Let me give you a quick overview of what we do and the purpose of these tests.
Ping Test: During this test, we will establish connections for multiple clients to any of the available SSIDs and execute PING sessions concurrently with varying time intervals. We will monitor and report packet loss and latency for the ping test as needed, based on specific requirements.
Throughput Test: In this test, we will connect all Real clients with various operating systems to the Device Under Test (DUT). We will subject the DUT to the total intended load in various traffic directions and types. Our testing includes comprehensive monitoring and reporting of data rates, achieved throughputs, and per-client throughput distributions.
FTP (File Transfer Protocol) Test: The purpose of this FTP test is to confirm that N clients connected to a specified band can download a file of various sizes from an FTP server simultaneously, while also measuring the time it takes for each client to complete the download process.
领英推荐
HTTP (Hypertext Transfer Protocol) Test: The purpose of this HTTP test is to confirm that N clients connected to a specified band can download a file of various sizes from an HTTP server simultaneously, while also measuring the time it takes for each client to complete the download process.
QOS (Quality of Service) Test: In this test, we will conduct various traffic scenarios with distinct ToS (Type of Service) values, which will include VOICE, VIDEO, BEST EFFORT, and BACKGROUND traffic. Depending on the number of clients participating, our objective is to determine which type of traffic receives the highest priority.
Multicast Traffic Test: In this test, we'll try sending data from one server to several clients, considering the number of real clients connected to the DUT (Device Under Test). We'll keep track of the Throughput attained for all the Individual clients from the server.
Mixed Traffic Test: The mixed traffic test is designed to measure the access point performance and stability by running multiple traffic on real clients connected to the access point. This test allows the user to choose multiple types of traffic like QOS, FTP, HTTP, Multicast and Ping test.
These are some of the interesting test reports generated using LANforge Interop Solution. You can find them in this drive link - Lanforge_Interop_Test_Reports. Also attached a snapshot of the Automated tests performed using Lanforge Interop below,
?
?
?
?
Great content please keep posting! Very helpful.
Software Development and Engineering (SDET)
1 年Interesting, follow up is there IoS support may be I missed it. Also for FTP,HTTP and tested the servers are within the LAN?
Wireless LAN QA
1 年When I was at Qualcomm, we had 400+ real devices being bombarded on an AP. A fully automated test bed doing different types of traffic with different power save mechanisms. One of the most powerful test bed it was from customer point of view. Any real time issues would hit within minutes or hours which would otherwise take many days to appear.