|

Automated Code Testing of Third-Party Software

View comments: newest first | oldest first | threaded
Page 1 of 2   Next >   Last >>
mfbertozzi
User Rank
Supply Network Guru
Re: Evaluate against performance metrics
mfbertozzi   4/23/2011 4:07:26 AM
NO RATINGS

This is good t.alex. Another way to analyze the topic is to consider costs in sw testing phases. In line with your opinions, Even tests have to be performed e2e, as possible tune or bug is discover in advance (i.e: static code stage), as costs to resolve and patch it will decrease.

t.alex
User Rank
Supply Network Guru
Re: Evaluate against performance metrics
t.alex   4/22/2011 8:19:02 PM
NO RATINGS

In some cases, static code analysis is required, such as automotive software.

mfbertozzi
User Rank
Supply Network Guru
Re: tests design
mfbertozzi   4/19/2011 3:45:54 PM
NO RATINGS

Tioluwa, it is a very good point. Based on my experience I can report sometimes "offshore" agreement is focused on basic testing, sometimes is focused on looking for outsourcers with expertise to conceive  & testing design and then in performing them as well. Of course as matter of costs and benefits, it easy to understand we are speaking about contracts with responsibility and economics completley different to each other.

mfbertozzi
User Rank
Supply Network Guru
Re: Evaluate against performance metrics
mfbertozzi   4/19/2011 3:34:19 PM
NO RATINGS

It is absolutely true. Overall testing fits better the strategy to provide results in line with users expectation, code testing is closer to developing phases. We must also add there are several testing phases in sw development process then right choice it depends on contract signed with outsourcer and task you want to demand.

TaimoorZ
User Rank
Supply Network Guru
Evaluate against performance metrics
TaimoorZ   4/19/2011 12:22:51 PM
NO RATINGS

From my experience, I have always found it much effective to test the overall software against performance metrics rather than test the code individually. Testing of code may be done on preliminary levels, but overall testing should be done by evaluating the system on the performance measures.

TIOLUWA
User Rank
Blogger
Re:
TIOLUWA   4/19/2011 8:53:17 AM
NO RATINGS

I'm wondering really who designs the Automated testing code.

If the third-party vendor does it, then there is really no way of guaranteeing anything.

However, if the client does it, then it means it is just as good as their ability to understand exactly how the software should work, without which they cannot really test anything, and from my experience, designing a testing application could be just as taking as designing the actual application itself, depending on the complexity.

Sometimes, i think outsourcing to third party software developers is not due only to inability to do the task, but its a way of saving time, especially for large firms like HP and the likes.

mfbertozzi
User Rank
Supply Network Guru
Re: Tests / Parameters
mfbertozzi   4/19/2011 7:55:39 AM
NO RATINGS

Well, generally speaking, number of tests to perform is  strictly related to: LOC (lines code numbers) or FP (function points). Other parameters to take in consideration are related to sw app's usage: real time or embedded device. Recent coding methodology based on uml/webml criteria allow more functions to measure performance, anyway  we would say right trade off in terms effor to spend, number of tests, features to test, way to perform them is the key role in charge of sw app testing outsourcer.

jbond
User Rank
Supply Network Guru
Re:
jbond   4/19/2011 7:16:07 AM
NO RATINGS

My only question is what measures or parameters are they using to analyze these results? And does the company have enough expertise in their staff to possibly come up with solutions if they find flaws? Is there a standard of measurement that is being used?

prabhakar_deosthali
User Rank
Supply Network Guru
Functioal testing is more important than code testing
prabhakar_deosthali   4/19/2011 5:24:57 AM
NO RATINGS

In my opinion, when some company is outsourcing the software development to a third party, it is obvious that it does not have enough expertise or resources to do the job on its own. In such a scenario it may not be able to validate the automated testing results also.  The best way could be , for the outsourcing company to have a test suite to test the functional requirements as given to the outsourced party. This way it can be checked whether the software meets the required functionality with all possible variations . The outsourcing company will have the expertise to design such test cases which will be indepedent of the code development and testing

hwong
User Rank
Supply Network Guru
Re: Code Testing
hwong   4/18/2011 8:38:38 PM
NO RATINGS

Yeah. indeed that's what most of the IT consulting companies like IBM/ HP Accenture/ Deloitte / get to make $$$$. The trend is that they would win the bid but then outsource it to India to perform the work

Page 1 of 2   Next >   Last >>


More Blogs from Andy Chou
Software codes are proliferating in the medical device supply chain, and mitigating risks in the system is now a priority for OEMs.
Third-party software codes are gaining grounds in the electronics industry but not enough is being done to test them rigorously.
What are the best practices and guidelines for managing a company's internal software supply chain?
Incorporating open-source components isnít as free or as effortless as it might seem
Twitter Feed
EBN Online Twitter Feed
EBN Dialogue / LIVE CHAT
EBN Dialogue enables you to participate in live chats with notable leaders and luminaries. Open to the entire EBN community of electronics supply chain experts, these conversations see ideas shared, comments made, and questions asked and answered in real time. Listed below are upcoming and archived chats. Stay tuned and join in!
Archived Dialogues
Live Chat 01/15: CPOs Re-Shape Their Business Roles
Increasingly chief procurement officers (CPOs) are re-shaping their organizational role to focus on creating results far beyond cost controls. A new IBM survey explores how.
Live Chat 11/12: Examining the Cyberthreat to Supply Chains
The number of cyberattacks is on the rise and hackers are targeting the supply chain. Drew Smith, founder and CEO of InfoArmor, will be on hand to discuss the reality of today's threat landscape and what to do about it.