In this paper, we outline an approach for automatically generating challenging road networks for virtual testing of an automated lane‐keeping system. Based on a set of control points, we construct a ...parametric curve representing a road network, defining the dynamic driving task an automated lane‐keeping system‐equipped vehicle must perform. Changing control points has a global influence on the resulting road geometry. Our approach uses search to find control‐point sets that result in a challenging road, eventually forcing the vehicle to leave the intended path. We apply our approach in different search variants to evaluate their performance regarding test efficiency and the diversity of failing tests. In addition, we evaluate different genetic algorithm control parameter configurations to investigate the most influential parameters and if specific configurations can be seen as optimal, leading to better results than others. For both studies, we consider another search‐based test method and two different random test generators as a baseline for comparison. The empirical results indicate that specific control parameter settings increase the overall performance for each search variant. While the population size is the most influential control parameter for all methods, the performance improvement when using optimal settings is only significant for one method.
This paper presents an approach for automatically generating challenging road networks for virtual testing of an automated lane‐keeping system, combining Bézier curves and a genetic algorithm. Furthermore, we present the empirical results of applying this approach in different search variants and genetic control parameter configurations. Our findings reveal considerable differences in test outcomes regarding test efficiency and solution diversity depending on the selected test generator configuration. These findings may provide useful insights, especially for the practical application of search‐based testing in the context of Advanced Driver Assistant System testing.
Selenium stands as open-source program apparatus aimed at computerization testing. Here, selenium-IDE (Integrated Developments Environment) Testing is investigated, which could be a remarkably vital ...movement in Program Improvement Handle. It is to look at and alter source code. A high-quality computer program can well be achieved by producing Compelling Testing. This Paper handles a critical in addition to the crucial issue of Program Testing. Testing can well be executed both manually and automatically. This paper sets to do Mechanization Testing through "Selenium". Test cases (TC) are consequently recorded with this web testing tool whilst the analyzer is entering the information in a web application screen.
Effective and efficient testing of complex component based software systems is hard. Isolated test cases that test isolated components are focused and efficient but are not effective in detecting ...integration faults. Integration test cases on the other hand are hard to develop and maintain. In this paper we present an unit test based integration meta-model and testing approach, to test the integrateability of component-based systems based on structural and behavioral information derived from test executions of the respective components' unit test cases. The meta-model is formalized using the property graph model and integration criteria are presented to detect certain types of integration faults early on. Last but not least we propose an approach to derive integration tests from the data contained in the model.
When creating a test automation infrastructure, one of the main considerations for the buildup process is its efficiency. A main cause and method for improvement might come from reuse of test ...automation artifacts. Following that, one may ask ?To what extent can the test automation artifacts be re-used??. In this paper we present a model and test automation architecture for achieving such a goal. Repository Driven Test Automation (RDTA) is a conceptual approach for the buildup process of test automation infrastructure that employs reuse of testing artifacts. This paper discusses aspects of reuse of software test automation artifacts on various levels. Then, practical implications and adjustments arising from the implementation of this new paradigm are discussed. The proposed concept is documented by a case study in an international innovative computer hardware manufacturer, one of leaders in the market. The documented results are significant and confirm the validity of the concept.
nema
An industry-academia collaboration developed a test automation framework for aviation simulation software. The technology has been successfully deployed in several test teams.
PurposeTesting business processes is crucial to assess the compliance of business process models with requirements. Automating this task optimizes testing efforts and reduces human error while also ...providing improvement insights for the business process modeling activity. The primary purposes of this paper are to conduct a literature review of Business Process Model and Notation (BPMN) testing and formal verification and to propose the Business Process Evaluation and Research Framework for Enhancement and Continuous Testing (bPERFECT) framework, which aims to guide business process testing (BPT) research and implementation. Secondary objectives include (1) eliciting the existing types of testing, (2) evaluating their impact on efficiency and (3) assessing the formal verification techniques that complement testing.Design/methodology/approachThe methodology used is based on Kitchenham's (2004) original procedures for conducting systematic literature reviews.FindingsResults of this study indicate that three distinct business process model testing types can be found in the literature: black/gray-box, regression and integration. Testing and verification approaches differ in aspects such as awareness of test data, coverage criteria and auxiliary representations used. However, most solutions pose notable hindrances, such as BPMN element limitations, that lead to limited practicality.Research limitations/implicationsThe databases selected in the review protocol may have excluded relevant studies on this topic. More databases and gray literature could also be considered for inclusion in this review.Originality/valueThree main originality aspects are identified in this study as follows: (1) the classification of process model testing types, (2) the future trends foreseen for BPMN model testing and verification and (3) the bPERFECT framework for testing business processes.
Advancements seeking structural components' strength and weight reduction necessarily pass through fatigue testing. Understanding failure phenomena and crack evolution is a way of methodologically ...achieving such a goal. An own‐designed resonant fatigue test rig was used to study the behavior of three distinctly manufactured crankshaft batches. A control system and a resonant frequency estimator were developed to follow the overall stiffness reduction with crack advancement. The control algorithm followed the frequency decay to compensate for the input load. The control strategies were validated by finding the system's natural frequency at the beginning of the test and maintaining a constant nominal load. Fractographies made with failed and non‐failed specimens revealed the connection between the expected physical results and the natural frequency shift evolution. The implemented logic enables crack advancement tracking and failure determination. The developments here can be overflown to different resonance fatigue systems to characterize their endurance performance.
Virtual simulation environments are widely used to test autonomous driving software by creating highly complex driving scenarios that are non-trivial to set up in a physical environment. However, the ...current practice of using the virtual test still does not fully utilize its potential to build a much larger scale test. We propose a perspective and research vision to build a large-scale test architecture in which participants collaboratively construct, execute and analyze complex test scenarios at scale in the virtual world. In particular, the architectural concept is built on the existing concept of the Collaborative Virtual Environment (CVE) that has been successfully applied in other domains, such as entertainment or military training applications. The proposed domain-specific architectural requirements extend the CVE to include the following necessary properties - selective sharing and collaboration - to test autonomous driving software. In addition, the test architectural concept is explained as to how a large number of participants interact with each other collaboratively to build and execute diverse test scenarios at scale. Finally, we explain the new research directions to make this test architectural concept realized for testing autonomous driving software.
In spite of the availability of most proficient quality assurance teams and tools, software testing has always been a time-consuming task. Thus test automation is being profoundly practiced in most ...of the software industries to leverage the total development time. Although the test automation has its own advantages and disadvantages and it influences various other development phases, the higher management is particularly interested in reckoning its effects on total software's cost, quality and time. In this paper, we have tried to ascertain some of the critical factors related to test automation and cost/return of/from automation. As automation is itself a pricy activity, it requires development effort and significant time, we have attempted to enumerate test automation's impacts on software's cost, time and quality on three different softwares. The results of our experiments clearly show the positive effects of test automation on cost, quality and time to market of the software.
Enabling continuous integration in a formal methods setting Couto, Luis Diogo; Tran-Jørgensen, Peter W. V.; Nilsson, René S. ...
International journal on software tools for technology transfer,
12/2020, Volume:
22, Issue:
6
Journal Article
Peer reviewed
In modern software development, the practices of continuous integration and DevOps are widely used to increase delivery speed and reduce the time it takes to deploy software changes to production. If ...formal method tools cannot be efficiently integrated in a DevOps paradigm, then their impact on software development will be reduced. In this paper, we present work addressing this issue through a series of extensions for the Overture tool supporting the Vienna Development Method. These extensions enable Overture to be used in a DevOps setting, through continuous integration and validation of models and generated code via integration with the Jenkins automation server. We frame the integration of formal methods and DevOps in a series of principles, demonstrate the value of this integration through a case study, and reflect on our experiences using formal methods and DevOps in an industrial setting. We hope that this work can help other formal method practitioners integrate their tools with DevOps.
PDF
