Within the context of a complex middleware development project, attempting to work on “next release” deliverables prior to gaining formal acceptance of the current release and reaching a “baselined” status can be a frustrating (and risky) exercise.
By their very nature, large development environments tend to be a little thin on the ground due to their associated licensing, hardware and maintenance costs -often projects will run only one “DEV” environment. As a customer goes... [More]
I seem to be talking and thinking about continuous testing, um, continuously lately. I had a little epiphany last week when I concluded that most of the pipeline is for testing. The pipeline starts with a continuous integration build where unit testing happens and a package, installable entity is produced. The pipeline ends when that packaged entity is deployed into production. Every step in between is for testing. Different kinds of testing, but they are all testing. So at a minimum, when there’s only one test stage, 30% of the pipeline... [More]
I had an awesome time last Saturday at CITCON in Boston. Not only were the views amazing but the conversations were thought provoking. The conference follows open-space technology which means that all the topics are meaningful to the participants (we get to vote!) and there is lots of interaction in every session.
I continue to be thinking about the issues related to test data in the continuous delivery pipeline that was a CITCON topic. It’s typical to create test automation expecting certain sets of data to be... [More]
Are you thinking about what to do about mobile testing? Everyone is talking about device fragmentation, but how do you manage to test and keep track of what’s different on each device type? We’re going to talk about ways to increase your reuse of manual or automated test scripts by leveraging a single multichannel approach to your automation on Tuesday, June 4 th at 1:45 PM in my Innovate 2013 called “Multichannel Testing - From Web to Mobile and Beyond.” If you haven’t signed up for Innovate,... [More]
I have always loved that subtitle on Dr. Strangelove – “ How I Learned to Stop Worrying and Love the Bomb” I have recently been thinking that better, faster, cheaper with continuous delivery and continuous testing means we really have to stop worrying about every defect. Which led me to Dr. Strangelove . It’s equally mind bending in some ways … so many years of looking under every rock for those defects. The worst possible thing was an “escape” to production and its requisite... [More]
I’m putting the finishing touches on my presentation for Innovate 2013 called " What’s the Real Deal with Testing? " My session will be Wednesday, June 5 th at 11:15 am. We’re going to have 90 minutes to talk about the real problems facing testers. Like what is this “continuous testing” thing? How much time do you spend setting up test environments and what’s the hardest part? Are you doing unattended testing? Do you want to? Join me for these topics and much, much more! If you... [More]
A colleague shared this article with me and much of the thinking aligns with where I’ve been landing on the topic of continuous testing. Of course, when reading the article, one thing jumps right out …. When the author, Marnie Hutcheson, expressed concerns about being able to complete the testing in the time frame specified (30 hours of testing, twice, over a weekend), she was, um, fired.
Felt to me as abrupt as hearing “you’re fired” on a certain television show. And the most... [More]
I’m still thinking about what the right content should be for continuous testing. My previous blog was about thinking about what test content matters. But there’s also the consideration of how much content and considering avoiding waste of building too much automation. I’ve had the experience several times of too much success (amazing, right?) in building automation. In those days, it was actually great to have a robust test automation suite that took 12-18 hours to run. We actually measured our success at... [More]
The Agile Manifesto guiding principles says,
“Our highest priority is to satisfy the customer through early and continuous delivery of valuable software.” (emphasis mine)
So as teams have adopted agile development practices, we have rapidly hit the delivery wall. The current conventional wisdom says to reduce risk, deliver more frequently and to make sure you’re not changing very much. I mean really, how much can you screw up in a day (or even a week)? So, if you can’t really screw much up AND... [More]
You may be hearing a lot about service virtualization lately and how it can help development organization overcome their testing challenges. Others may be wondering what the heck I am talking about when I when I use a phrase like service virtualization. In fact, during the recent IBM webcast Practical Tips to Successfully Test Complex Applications from the authors of "Service Virtualization For Dummies" , 65% of the attendees had no knowledge of service virtualization and another 18% had just begun the learning process by reading... [More]
Many years ago, we used to talk to our customers about the
need for automated testing. Test teams built
long lists of manual tests and struggled to finish their testing on time, not
to mention the difficulty they had with managing these tests. These days however, software development organizations
do a reasonable job of automating their testing because there are has been a reemphasis
on the importance of quality. Unfortunately,
there are still other significant challenges being faced by testers.
The first major one is that... [More]
Just wanted to let everyone know about some new and upcoming IBM sponsored webcasts to assist development teams in their pursuit of quality. At the StarWest 2012 conference in Anaheim, Peter Cole, Director for Quality Management, IBM Rational delivered a session on " Accelerating the Software Development Lifecycle Using Service Virtualization ". During this session Peter shared how, service virtualization can produce dramatic results including reducing cycle times, improving quality, and cutting costs. When coupled with the cloud,... [More]
At one time and for many development organizations, an
entire application was written in house. When development was finished and the
entire application was available in a test environment, the test team took over
validating that the business requirements were met. However, more often than
not, the delivery deadline was missed due to a lack of quality or required
functionality and projects requested more money to keep going or they simply
plunged over the waterfall meeting their demise.
Then along came iterative development and... [More]
Couple of months back, IBM took recognizing technical thought leadership by announcing IBM Champion program . An IBM Champion is an IT professional, business leader, developer, or educator who influences and mentors others to help them make best use of IBM software, solutions, and services. The interesting part is IBM Champions are not IBMers! IBM Champions have gone above and beyond to share their knowledge for the benefit of a wider community through their participation in communities, articles, whitepapers and speaking assignments. Out... [More]