登录查看更多内容

What are the best practices for conducting system testing on a tight budget?

由人工智能和领英社区提供技术支持

System testing is a crucial phase of systems engineering, where you verify that your system meets the requirements and specifications, and performs as intended in the real-world environment. However, system testing can also be expensive and time-consuming, especially if you have a complex, large-scale, or safety-critical system. How can you conduct system testing on a tight budget without compromising quality and reliability? Here are some best practices to help you plan, execute, and evaluate your system testing efficiently and effectively.

此文章中的业界达人

由社区从 10 条内容中精选。了解更多

Christopher Duffey

Planetary Sciences Graduate Student and Aerospace Engineering Consultant
Dr. Rashid Ali CEng, CITP, SFHEA, FRSA, FBCS, FRAeS, FIMechE

Shaping the future through influencing bright minds.
Akif ALIC

System Architect at Viessmann Climate Solutions

1 Define your test objectives and scope

Before you start testing, you need to have a clear idea of what you want to achieve and how you will measure it. Your test objectives should align with your system requirements and stakeholder expectations, and specify the criteria for success and failure. Your test scope should define the boundaries and limitations of your testing, such as the features, functions, interfaces, scenarios, and conditions to be tested, as well as the ones to be excluded or deferred. By defining your test objectives and scope, you can focus your testing on the most important and relevant aspects of your system, and avoid wasting resources on unnecessary or redundant tests.

添加您的观点

Dr. Rashid Ali CEng, CITP, SFHEA, FRSA, FBCS, FRAeS, FIMechE

Shaping the future through influencing bright minds.
举报内容
A robust DoE (design of experiment) .. why we need to test how is it to be tested what will be the key outputs ? how will the inputs be validated? What are the limitations of the tests ? What are the likely source of errors? The more we understand the testing methodology and the testing technique the less time is spent on chasing spurious results, which are inevitable as a result of an ill-conceived test.

已翻译

赞
Akif ALIC

System Architect at Viessmann Climate Solutions
举报内容
Have you ever heard architectural drivers? V&V is one of the most important architectural driver. Therefore on the contrary to common belief, starting to think about testing should start very early state of the development activities which would secure successful completion of the testing with most effective way.

已翻译

赞
Satyendra Kumar Sharma

Senior SDE @ SAP Labs ? ex-Microsoft ? ex-Oracle
(已编辑)
举报内容
In my opinion, Test Driven Development is the solution here. If you ensure that your actual business logic and programming practice is led by creating the tests first, then it is going to be not only cost-efficient but also fortify reliability on your test suite.

已翻译

赞
Derek Nolek, PE, LEED AP

National Practice Leader, Ground Support Equipment Engineering at BRPH
举报内容
Determine the technical risks your future system may have. A DFMEA and PFMEA are great tools to help capture the failure modes, and document the mitigations. Testing is one method of validating a system design. Analysis, Inspection and Similarity are the others. Do all methods of validation or a few is determined by the consequence of failure.

已翻译

赞

2 Choose your test methods and tools wisely

Depending on your system characteristics, requirements, and constraints, you may have different options for how to conduct your system testing. For example, you may use simulation, emulation, prototyping, or live testing, or a combination of them. You may also use manual or automated testing, or a mix of both. Each of these methods and tools has its own advantages and disadvantages, such as cost, speed, accuracy, reliability, scalability, and coverage. You should choose your test methods and tools based on your test objectives and scope, as well as your budget and schedule. You should also consider the trade-offs and risks involved in each option, and how they may affect your test results and conclusions.

添加您的观点

3 Optimize your test design and execution

When designing and executing your test cases and procedures, it's important to apply best practices to maximize test efficiency and effectiveness. This includes creating a test plan that outlines the strategy, approach, resources, roles, responsibilities, schedule, and deliverables. Additionally, you should use a test matrix to map the test cases to the test objectives and requirements. Moreover, a test case template should be used to standardize the format and content of your test cases. Similarly, a test procedure template should be used to standardize the format and content of your test procedures. Furthermore, a test management tool can help organize, execute, monitor, and report testing activities and outcomes. In addition, a test automation tool can be used to automate repetitive or complex tasks. Finally, you can use a test optimization technique to reduce the number of test cases or procedures without compromising quality or coverage.

添加您的观点

4 Evaluate your test results and outcomes

Once you have completed your test execution, it is important to evaluate your test results and outcomes to determine if your system meets the test objectives and requirements, and functions as anticipated in a real-world environment. To do this, best practices such as using a test report template to standardize the format and content of the report, a test metrics dashboard to visualize and summarize test performance, quality, and progress, a test analysis technique to identify and understand root causes, patterns, trends, and impacts of results and outcomes, and a test feedback mechanism to communicate with stakeholders should be applied. The test report template should include items such as the report ID, name, description, objectives, scope, methods, tools, results, outcomes, conclusions, recommendations, and attachments. The metrics dashboard should include items such as the number of test cases, procedures, executions, passes, failures, defects and coverage. For test analysis techniques you can use the Pareto analysis, fishbone diagram or fault tree analysis. Finally for the feedback mechanism you can communicate with customers, users developers and managers to solicit their opinions on the results and outcomes.

添加您的观点

Derek Nolek, PE, LEED AP

National Practice Leader, Ground Support Equipment Engineering at BRPH
举报内容
How closely your test matches the conditions you expect the system to face will determine how applicable the results are. Use your test results (good and bad) to further explore unknown unknowns.

已翻译

赞

5 Learn from your test experience and improve

Finally, it's not enough to just evaluate your test results and outcomes. You should also learn from your test experience and improve your system testing process and practices for the future. To this end, you should use a test lessons learned document that captures and documents challenges, successes, failures, best practices, and lessons learned. You should also use a test improvement plan that defines and prioritizes improvement actions, goals, measures, and responsibilities. Additionally, you should use a test maturity model to assess and benchmark your test process and practices against industry standards and best practices. System testing on a tight budget can be challenging, but not impossible. By following these best practices, you can conduct system testing that is efficient, effective, reliable, and valuable for your system engineering project.

添加您的观点

FARHEEN BEGUM MIRZA

Enabling Indian Aerospace & Defence | AeroPortfolia - Elevating Operations & Engineering Research | Adjunct Faculty (Avionics) | Prolific Speaker |
举报内容
One of the most practical solutions these days is to incorporate the DIGITAL TWINS rather than using the actual systems themselves under test. In the world of AI, efforts are ON to get everything automated. Hence, there needs to be no involvement of mankind , resources, whatsoever ..

已翻译

赞

6 Here’s what else to consider

This is a space to share examples, stories, or insights that don’t fit into any of the previous sections. What else would you like to add?

添加您的观点

Christopher Duffey

Planetary Sciences Graduate Student and Aerospace Engineering Consultant
举报内容
One of the things that has always helped me in affordable and effective testing is making sure that systems and software are designed with testing and instrumentation in mind up front - that is designers are encouraged/required to design in ways to gather data and monitoring operations that might not be necessary in the final product but will great enhance testing and troubleshooting. One of my mentors referred to this as “scaffolding” that gets left behind for future re-use.

已翻译

赞
Bert Schneider

Retired from Raytheon and Air Force
举报内容
Assuming your system has rock solid, documented requirements, I would do the following: 1. Clearly define and get buy in from your customer(s) and stakeholders your Measures Of Performance (MOPs) and Measures Of Effectiveness (MOEs). 2. Using a Design Of Experiements (DOE) I would structure your testing using your well defined MOPs and MOEs, to optimize and minimize the number and type of testing required. 3. Draft the test report up front, with blanks/spaces for results. This will help your team to focus on any deliverables and/or documentation artifacts early on, so you can spend quality time on the testing and also ensure a rock solid product in the end.

已翻译

赞
Derek Nolek, PE, LEED AP

National Practice Leader, Ground Support Equipment Engineering at BRPH
举报内容
Don't test just to test. Use testing as a subset of validation activities. Sometimes you just can't test a system in the full conditions needed. For these untested scenarios find way to test components on their own, perform analysis and simulation on off nominal performance cases. Evaluate the system response for various component failures. What are the consequences?

已翻译

赞
Shadab Rizvi

Senior Architect @Persistent Systems
举报内容
Expectations and stakeholder management is key in this scenario... The Test plan should be communicated to all stakeholders so that nobody claims ignorance at a later stage... Risks and their mitigation actions should be discussed thoroughly so that every body is on the same page.

已翻译

赞

Systems Engineering

+ 关注

给文章评分

我们借助人工智能创建了此文章。您认为这篇文章怎么样？

很棒不太好

举报此文章

查看全部

What are the best practices for conducting system testing on a tight budget?

1

2

3

4

5

6

1 Define your test objectives and scope

2 Choose your test methods and tools wisely

3 Optimize your test design and execution

4 Evaluate your test results and outcomes

5 Learn from your test experience and improve

6 Here’s what else to consider

Systems Engineering

给文章评分

感谢您的反馈

更多Systems Engineering相关文章

更多相关阅读内容

What are the best practices for conducting system testing on a tight budget?

1

2

3

4

5

6

1 Define your test objectives and scope

2 Choose your test methods and tools wisely

3 Optimize your test design and execution

4 Evaluate your test results and outcomes

5 Learn from your test experience and improve

6 Here’s what else to consider

Systems Engineering

给文章评分

感谢您的反馈

查看其他技能