Verifying the behavior of a software system against the expected behavior of that system.
0
votes
0answers
11 views
Does CI servers allow maven to generate content outside target directory?
I'm maintaining a Multi Module Maven project, I have a module that contains some tests, the tests run smoothly locally, but on the integration server they don't, and the logs shows only FileNotFound ...
5
votes
3answers
148 views
Should unit tests always overlap
This is a test design question. I have a class 'handler' that accepts a 'validator' that checks some business logic on what's passed to the handler.
I made the unit tests for the validator and now ...
1
vote
1answer
65 views
Testing a bootloader written from scratch?
I'm planning to write a simple bootloader. Nothing too complicated. Just really basic output and maybe keyboard input.
But it seems a bit crazy to restart my computer every time I want to run the ...
0
votes
1answer
158 views
Should I have code that only exists for testing?
I have a service class which is responsible for instantiating repositories and using them. It makes an external Http request which ideally I would like to mock for testing. However, I am not quite ...
1
vote
2answers
51 views
How short/stable should tests/build be for working CI/CD pipeline?
(Please note that this question is linked to this: How can Continuous Delivery work in practice? - but it asks a more specific question regarding time and stability).
CI/CD, no manual QA, super quick ...
5
votes
3answers
181 views
Is this the wrong environment for CI?
Background
Team/Project Size
Currently at our company, we have a team of 3 developers. We each have our own projects that we work on. So, we never have more than one person working on a software ...
0
votes
0answers
3 views
Problems with buffer telnetlib [migrated]
I'm developing a software which make telnet connections to send the scripts to the routers. I need to save the logs of each router in txt files but at the end the shows commands saves are incomplete, ...
-1
votes
0answers
38 views
Writing an Overall test plan for a system?
I need to write an overall test plan for a system outlining our strategy for Verification and validation testing. In this document i need to include a strategy for unit testing, integration testing ...
0
votes
0answers
34 views
Tracking a program-wide state of tasks being done and making it testable
I have a program which does some processing which can be asynchronously requested (WCF). There should be only one computation per identifier (always supplied upon request). So if at some point work is ...
-2
votes
0answers
54 views
Test Cases in an Interview Setting
In the first cracking the coding interview video Ms. McDowell talks about candidates that begin by writing test cases in whiteboard interviews. How would one go about this?
For example, the ...
0
votes
0answers
11 views
Approach for efficiently working on view controllers in iOS app
When working on a specific view controller within an app, my approach has always been to make some changes to the code, launch the app, navigate to the view controller and see if everything is ...
0
votes
0answers
25 views
Alternate Perl environment for testing [migrated]
My testing environment includes some older platforms. I'm trying to test OpenSSL on an older Debian 6 platform, and the OpenSSL test scripts are having trouble with Perl 5.10. So I am trying to fix a ...
1
vote
2answers
107 views
From a software development lifecycle perspective, is duck-typing a benefit or a problem?
Statically-typed languages such as Java afford the benefit of compile-time checking of types - you are guaranteed that an object is of a given type, so:
there is no need to spend time and resources ...
3
votes
1answer
62 views
GUI Testing With Network
I am doing GUI tests for my network application and I'm wondering if I should stub out mock responses, or if it's OK to keep using the network for the GUI tests.
It seems to me the main benefits of ...
2
votes
3answers
197 views
Browser Web Application UI/End User Testing
I am building a web application in php. I am following TDD (write tests before production code) for my unit tests and using BDD to drive discovery of my applications features and to provide ...
4
votes
5answers
87 views
What are the best practices for managing Test results
We are using GitHub for managing source code and waffle board for managing workflow/issues.
Right now when we test the system using custom written test cases, it generates a CSV file. We want to be ...
5
votes
2answers
126 views
The concept of “quality gates” in software testing
We are using SonarQube for code quality testing. It tests the quality of code, and not the function of code. It has the concept of quality gates, so you can set for instance a 90% quality gate, ...
7
votes
3answers
204 views
What should be the scope of a health check for a system which deploys a webapp?
Today I had a task to "write a health check" for a long running service that is an orchestration system to deploy a web-app.
I am trying to determine what the scope for such a health check would be, ...
1
vote
2answers
55 views
How much optimisation should one put in for slow integration test setups
I have some very slow integration tests that use Selenium and require a lot of database setup. The setup and tear down times are in the order of tens of seconds while the test bodies only take a few ...
0
votes
2answers
97 views
Spring-MVC : Testing code by automatically running it in UI
I am working on a Spring-MVC application(config XML based, no Main class) in which I would like to do testing. I have known that there is a way to test code which is backend+frontend code. For that, I ...
4
votes
3answers
158 views
What kinds of bugs can integration testing actually find?
I feel like, in web dev at least, that integration tests can't really find any useful bugs. I can't think of any, at least. If I can use unit tests to verify that one section of my code calls a ...
0
votes
0answers
15 views
Writing test cases for another web service
I'm working in a team as a developer. We have developed a product where we generate letters by populating some XML file. This XML file ONLY contains some texts that need to show up in a pdf document. ...
3
votes
4answers
103 views
Test cases do all the work through helper method — bad practice?
Consider a test suite like this:
public class MyTestSuite {
@Test
public void test_something() {
testHelperMethod("value11", "value12", "value13");
}
@Test
public void ...
3
votes
1answer
57 views
How do you properly test a complete software replacement
We have System A (an application and a database) that is built for a specific business department and therefore has business aligned data model and table structure.
System A is a mission critical ...
5
votes
4answers
202 views
Can we encourage our test team to collaborate with developers on automating tests?
I am a C# developer, and my team and I are trying to start automated functional tests. (Note that we don't want to do Unit Tests; we expect to develop tests which test one function point per test)
...
2
votes
1answer
132 views
What is the proper infrastructure and release cycle for developing and testing an application? [closed]
I am developing a web application for my coworkers, and from a little management app it is becoming a more and intense large project that is involving more people as I go. I am pretty sure my boss ...
7
votes
1answer
154 views
How to test calculations that are only passed down into the stack rather than returned upward
This is a problem I have been trying to wrap my head around a couple months now. It has shown up again in a learning project I was working on last night, so I will use that as an example.
I am ...
1
vote
0answers
35 views
Rules of thumb for test coverage [closed]
In general it makes sense to me to unit test everything besides glue classes which have no logic. They often catch mistakes and code smells even at the time of writing let alone protecting you from ...
1
vote
4answers
114 views
How and where to test if the JSON request objects generated by the front-end is valid
We have built a complex Angular application that sends multiple HTTP request to a REST service that is also built in house.
Since both the frontend and the backend is being developed in parallel, ...
0
votes
2answers
80 views
How can I test code that verifies data sanity?
I have a large data structure that gets read in from XML. I've been given a large list of constraints that should hold between data members. For example, one of the constraints might look like
...
4
votes
2answers
71 views
Testing strategies for interpreter language parser
For a recent personal project, I started working on an interpreter for my own programming language. One of the ground rules I set for myself on this project is that I need to properly test as much of ...
0
votes
2answers
57 views
Possible to get path coverage but not condition coverage or other way around?
I was wondering if it was possible to get path coverage(executing all paths) but not condition coverage? Also, how about the other way, condition coverage, but not path coverage? A concrete example ...
3
votes
1answer
92 views
Is it unreasonable to implement a small domain specific scripting language?
At my new job, they are currently spending scores of labor hours that we don't have to do manual QA testing after every build. Nothing is automated at all. (We can only afford three developers, and ...
2
votes
2answers
74 views
How to enable my team to run integration tests against RedShift in parallel?
I am working with Docker to run my integration tests, it works pretty nice:
I startup my docker containers (one with my server and one with the database)
I run the IT using arquillian against these ...
-1
votes
1answer
69 views
Considering the testing software issues when designing software [closed]
When designing the software, must we consider how much this code could be testable? for example, if we used X technology/Class/Interface instead of Y, based on that X can be tested more easily than Y, ...
1
vote
0answers
38 views
How are JSON Web Token validators tested?
JSON Web Tokens (JWTs) are an open, industry standard method for representing claims securely between two parties. There are numerous implementations for JWT verification, but it looks like each ...
0
votes
2answers
373 views
“I'm done with my coding” from Agile perspective
Scenario: I'm working in an Agile environment. The dev environment has not been configured yet, and I'm told to code a piece of an application.
I code the module and write appropriate unit tests for ...
-2
votes
1answer
97 views
Dynamic things to test, does it make sense? [closed]
I wrote like seven tests for testing if our network topology was working fine. Each one in a file, so I had test1, test2, test3...
However, right now my boss is asking me for something more dynamic, ...
1
vote
3answers
104 views
Are debug-build-only UI controls a bad practice?
Often, to simplify testing, I add UI controls that are only visible and enabled in debug build only. Or prepopulate mandatory input fields in debug build. Is this a bad practice? Assuming the release ...
2
votes
1answer
72 views
How to write tests for browser automation script
I have a couple of scripts (two in Python, one in Java) that use Selenium to drive a browser and download files from a website.
I need to do some major refactoring before I do a major expansion, so I ...
3
votes
3answers
195 views
Unit Testing and 3rd party packages. Do I mock or not?
I'm just getting used to unit testing and on my new project I decided to adopt a TDD approach.
My code below is to test the UserServices class which is responsible for creating a user, deleting a ...
5
votes
2answers
252 views
Report test failures “all at once”, or report them one by one
I am a sole developer working for an organisation that has no testing strategy.
I am trying to integrate a crime system developed by a vendor with an external application I developed. The external ...
-2
votes
3answers
163 views
What is the most elemental workflow for TDD?
Gradle is such an interesting build tool that it prompted me to look at Spock and JUnit -- which I've never done before. What is the basic workflow with TDD?
My approach has been to do frequent ...
-1
votes
1answer
105 views
What do developers do during testing phase of a waterfall life cycle? [closed]
If the testing phase is over 5 months long do the developers help the testers execute scripts? I don't know how it's done in a waterfall lifecycle where the phases are usually quite long.
4
votes
3answers
101 views
Unit Testing Module-Internal Functions
I'm writing a simple whitebox unit testing suite for a project I'm working on in C. The project is broken into modules (each has a .c file with an associated .h file), and all modules are compiled ...
0
votes
0answers
28 views
Test architecture for feature that spans several modules
We have several modules that handle various parts of an incoming message. Each module does some unrelated work on the message (for example, write to the DB; send to the client), and all modules are ...
2
votes
2answers
143 views
What is it called when you test a microservice by mocking the dependencies?
I've a RESTFul microservice written in Grails. This microservice has it's own DB. It also depends on two other microservices.
A typical workflow of the service is:
Receives a GET request from a ...
3
votes
4answers
232 views
Cleanup & Arrange practices during integration testing to avoid dirty databases
I'm coding tests in C# and I settled with this structure:
try
{
// ==========
// ARRANGE
// ==========
// Insert into the database all test data I'll need during the test
// ...
80
votes
9answers
9k views
What's the point of running unit tests on a CI server?
Why would you run unit tests on a CI server?
Surely, by the time something gets committed to master, a developer has already run all the unit tests before and fixed any errors that might've occurred ...
0
votes
0answers
30 views
Testing Browser/OS combinations
We support IE9, IE10, IE11, Chrome and Firefox, and we support them on Win7, Win8, Win8, and Win10.
If we tested every possible combination of browser and OS that would be 20 times through our script ...
