Thursday, September 26, 2013

Test Execution Trend feature added in TTA (0.5.7)

A new version of Test Trend Analyzer (TTA) is now available on github.

These are the new features in it:

  • Test Execution Trend - to see the benchmarking of specific test execution over a time period
  • Failure Analysis View
    • Modified view to show failures for specific Test category along with specific test run
    • Modified view to show failures for All test categories with latest test run
  • Minor Refactoring for Compare Runs view
  • Query optimisations + minor defect fixes.
For those that missed the earlier announcement - summary of features of TTA is available here, and source code is available on github.


PS: There is a lot of work (features / UI) planned for TTA. If you wish to contribute, we would love your help!!

Tuesday, September 10, 2013

vodQA - Faster | Smarter | Reliable - on Saturday, 19th Oct in Pune

After what seems to be ages, I am very happy to announce the next edition of  
vodQA - Faster | Smarter | Reliable coming to you on Saturday, 19th Oct, 2013 at ThoughtWorks, Pune.


In this edition of vodQA, the focus will be on cutting edge testing technology, which will help us to understand how to be more faster,smarter and reliable in our testing approach. It will ameliorate our testing strategy in a faster and smarter world , following the best practices at the same time. The emphasis will be more on discussing ideas which enable us to test smartly instead of testing more.

We are hoping to target following questions in coming vodQA edition:

- What all things I should start doing to be more effective and impactful Quality Analyst ?

- What all process, tools and techniques I can use to get more faster and yet reliable results ?

- Can I use the tool I am already using in some different way which will make my testing effort more effective, more faster and more reliable ?

- What can I do so that software I am working on is always in production readiness state ?

- Are there any ways in which I can reduce my test life cycle ?

For registration details, click here (http://bit.ly/18LSnjc).

For all past vodQA information, see here.

Saturday, September 7, 2013

TTA (0.5.4) feature information and screenshots

Here are some screenshots from the current functionality supported by TTA v0.5.4.

See the TTA Wiki page or Contact me for more information on TTA.


Manual upload of Test data

Test Pyramid

Comparative Analysis

Compare different test runs

Test Failure Analysis
Integrate External Dashboards with TTA

TTA Statistics page

Saturday, August 31, 2013

TTA - closer to becoming unified dashboard for Test Trends and Status

Test Trend Analyzer (TTA), went live again today !!! We are now at version 0.5.4.

In the past week we have made a bunch of improvements and added new features - Integrating External Dashboard , which takes TTA closer towards being the central dashboard for testing status across the organization.
 
There are a couple of projects within ThoughtWorks using this, and also some other organizations.

Here is the list of new Features:
  • Integration of external dashboards (add from /admin page, see integration on /home page) - this allows one to integrate different existing dashboards into TTA - to make it a one stop place for seeing all Testing related information. Example: You can integrate your defect reports from Mingle / Jira / etc., or, you can also integrate your specific Continuous Integration (CI) dashboard from Go / Jenkins / Hudson / Bamboo / etc.
  • Compare test runs (/compare_runs) - to compare specific test runs --- 
    • what are the common failures, 
    • what are the unique failures, 
    • what failed on date 1, but passed on date 2
    • what failed on date 2, but passed on date 1
  • TTA Statistics Page (/stats) - to know usage of TTA by different projects / teams in your organization
  • Fixes + minor UI modification
Features available from some time:
  • Test Pyramid view (/pyramid) - to see how your project's automation effort aligns with the Test Automation philosophy
  • Comparative Analysis view (comparative_analysis) - to see the trend of your test automation results over a period of time, and if any patterns emerge
  • Failure Analysis view (/defect_analysis) - to make better meaning of the test failures, and help you prioritize which failures should be fixed first.
  • Upload Test Run Data manually (/upload) - to manually upload test data in case if you have not uploaded test data automatically to TTA, but still want to use TTA
 
More information about features, how to use TTA, etc. can be found on this blog, TTA-github, TTA-github-wiki, or by contacting me.

Monday, July 29, 2013

TaaS @Agile2013

[UPDATE] Final update: The slides AND the audio recording (mp3) of my talk in Agile2013 are now available.

[UPDATE] Slides for the presentation are now available here.
 
So close, yet so far .... dreading the 15.30 hour non-stop flight from Mumbai to Newark, yet super excited to speak in Agile 2013, Integration testing in Enterprises using TaaS - via Case Study, on 5th August, from 2pm-3.15pm. Complete schedule is available here.


Monday, July 15, 2013

TaaS and BDT - back to back at WCNGT, Bangalore

I had a great time talking about TaaS and BDT at WCNGT conference in Bangalore on 11th July 2013.

Here is more information about the talks:

Integrated Testing in Enterprises using TaaS:

http://essenceoftesting.blogspot.in/2013/07/taas-in-wcngt-bangalore-and-agile-2013.html
The audio recording of the talk is available here.
The slides for the talk are available here.
TaaS is available on github and as a gem on rubygems.org.

Building the "right" regression suite using Behavior Driven Testing (BDT)

http://essenceoftesting.blogspot.com/2013/07/building-right-regression-suite-using.html
The audio recording of the talk is available here.
The slides for the talk are available here.

Wednesday, July 10, 2013

Building the "right" regression suite using Behavior Driven Testing (BDT)

As a last minute surprise, I have been requested to talk about Building the "right" regression suite using Behavior Driven Testing (BDT) in the World Conference on Next Generation Testing on 11/12 July 2013 in Bangalore. This is another of those topics I feel very strongly about and am very excited at this opportunity.

What this does mean though is that I have back-2-back 2 1-hour sessions at WCNGT2013 - first - Integrated Testing in Enterprises using TaaS, and immediately post lunch - the BDT talk. 

Should be fun ... and hopefully I don't mix up the content in the talks :)

Here is the high-level agenda of the topic: Building the "right" regression suite using Behavior Driven Testing (BDT):


  • Overview of Agile Testing
  • The Test Pyramid
  • Different flavors of TDD
  • BDD – Behavior Driven Development?
  • ATDD – Acceptance Driven Development?
  • BDT – Behavior Driven Testing?
  • Difference between BDD and BDT
  • Tools that support BDT
  • The value proposition for the team - live documentation, business rules, onboarding, etc.

Monday, July 8, 2013

TaaS in WCNGT, Bangalore and Agile 2013, Nashville, USA

A busy couple of weeks for me as I talk about TaaS in World Conference on Next Generation Testing in Bangalore, on 11/12th July 2013, and in Agile 2013 in Nashville, USA, on 4-9th August 2013.
 
My session details are as follows:

In WCNGT - Integrated Testing In Enterprises Using TaaS, on 11th July, from 12pm-1pm. Detail program is available here.



In Agile 2013, Integration testing in Enterprises using TaaS - via Case Study, on 5th August, from 2pm-3.15pm. Complete schedule is available here.




Saturday, June 22, 2013

vodQA mobile in July

July will see a strong dose of vodQA - focusing on Mobile Testing.

We start off with vodQA Gurgaon - Agility in Mobility on Thursday, July 11 2013 – 5.00 p.m. to 7.30 p.m.

Then, we have vodQA Chennai - Served on Mobile on Saturday, July 20 2013 – 09:30 AM - 4:30 PM.

Help share the word, and see you there!