JK Vine Consulting offer comprehensive performance testing and tuning services that verify the compliance of IT solutions to client stakeholder non functional requirements, linked specifically to system performance, scalability and endurance. Any identified performance anomalies will be isolated, identified, tuned and retested.

Due to the conflicting forces of delivery timeframes, system functional stability and project costs, the challenge of a limited window for formal performance testing and tuning is typically presented to most modern IT projects. JK Vine Consulting offers the following to address this challenge and maximise the corresponding Return On Investment:

Performance Testing & Tuning: PLAN Phase

  • Approaches for all project sizes:
    • Accelerated approach for small-scale projects
    • Methodologies for Enterprise-Wide Programs of Work, including:
    • Load test script frameworks: in-line with Development Best Practises (eg. OO principles); designed for enterprise needs (eg. reuse, off-shoring, reduced plasticity, etc)
    • Test Data Strategies
  • Early Performance Testing Considerations. Processes to identify and address performance issues before deployed to Production-like test environments. Thus reducing the risk of Unit and System Test Performance defects and design issues being identified during the final Performance Testing and Tuning phases.
  • Formal Performance & Load Testing & Tuning strategies
    • Real-time Batch, and Data Migration performance testing (including [system and UI] Performance, Scalability, Stress and Endurance/Soak Testing and Tuning). Performance Test
    • Tooling (Commercial or Open-Source) Selection

Proven Methodologies

Performance Testing & Tuning: BUILD Phase

  • Preparation activities:
    • Scripting & Data Creation:
      • Efficient and reusable test script creation in: LoadRunner, QALoad, JMeter, Grinder, Oracle Application Test Suite, iTKO Lisa, SilkPerformer.
      • Optimal test data generation/preparation
    • Metrics/Diagnostics preparation. Deep understanding of system metric aggregators (Sitescope, OEM, etc), application server performance collections suites (HP Diagnostics, JRockit Mission Control, Performasure, etc) and a thorough appreciation of additional performance diagnostic toolsets, including:
      • Application Server Tools (eg. JProbe, MDD4J, Heap Analyzer, Thread and Monitor Dump Analyzer for Java)
      • Database tools (eg. Grid Control, MySQL Query Analyzer)
      • Operating System and Network Tools (eg. DTrace, Wireshark)
    • Establish Test Environment Delivery and Maintenance controls
  • Early Performance Testing. Where appropriate, the following early performance test options can be conducted during the Build phase:
    • Static Testing:
      • Quick-start Risk Assessments
      • NFR reviews (esp. testability, gaps)
      • Design Reviews (esp. ensuring agreed performance budget allocation for key transactions is obtained at design by all parties => can build to and test against [or re-design &/or re-set expectations prior to testing])
    • Component Performance Verification/Acceptance (incl Application Profiling, Code Scanning)
    • Low Volume, Capacity Modelling

Performance Testing & Tuning: RUN Phase

  • Test Execution and Tuning:
    • Execution of planned performance, scalability and endurance tests
    • Analyse test results and correspondingly assist tune the underlying code, server, and/or operating environments of the system under test.
    • Certify system performance compliance to agreed SLAs and/or NFRs prior to Production deployment.
    • Provision recommendations and Capacity models for Production performance monitoring and support.
  • Warranty/Support services
    • Test result correlation to Production observations and capacity plans and management.
    • Assist Production Environment issue resolution
    • Transition to Test Competency/BAU