Testing at Google Scale Product Description 2012 Jolt Award finalist! Pioneering the Future of Software Test Do you need to get it right, too? Then, learn from Google . Legendary testing expert James Whittaker, until recently a Google testing leader, and two top Google experts reveal exactly how Google tests software, offering brand-new best practices you can use even if you?re not quite Google?s size? yet! Breakthrough Techniques You Can Actually Use Discover 100% practical, amazingly scalable techniques for analyzing risk and planning tests?thinking like real users?implementing exploratory, black box, white box, and acceptance testing?getting usable feedback?tracking issues?choosing and creating tools?testing ?Docs & Mocks,? interfaces, classes, modules, libraries, binaries, services, and infrastructure?reviewing code and refactoring?using test hooks, presubmit scripts, queues, continuous builds, and more. With these techniques, you can transform testing from a bottleneck into an accelerator ?and make your whole organization more productive! Features + Benefits Presents pioneering testing techniques that can help any company moving to the cloud Shows how to achieve web-level scale for integration and system testing Offers expert guidance on managing end-to-end testing, including superior automation strategies Foreword by Alberto Savoia xiii Foreword by Patrick Copeland xvii Preface xxiii Chapter 1: Introduction to Google Software Testing 1 Quality?Test 5 Roles 6 Organizational Structure 8 Crawl, Walk, Run 10 Types of Tests 12 Chapter 2: The Software Engineer in Test 15 The Life of an SET 17 Development and Test Workflow 17 Who Are These SETs Anyway? 22 The Early Phase of a Project 22 Team Structure 24 Design Docs 25 Interfaces and Protocols 27 Automation Planning 28 Testability 29 SET Workflow: An Example 32 Test Execution 40 Test Size Definitions 41 Use of Test Sizes in Shared Infrastructure 44 Benefits of Test Sizes 46 Test Runtime Requirements 48 Case 1: Change in Common Library 52 Test Certified 54 An Interview with the Founders of the Test Certified Program 57 Interviewing SETs 62 An Interview with Tool Developer Ted Mao 68 An Interview with Web Driver Creator Simon Stewart 70 Chapter 3: The Test Engineer 75 A User-Facing Test Role 75 The Life of a TE 76 Test Planning 79 Risk 97 Life of a Test Case 108 Life of a Bug 113 Recruiting TEs 127 Test Leadership at Google 134 Maintenance Mode Testing 137 Quality Bots Experiment 141 BITE Experiment 153 Google Test Analytics 163 Free Testing Workflow 169 External Vendors 173 An Interview with Google Docs TE Lindsay Webster 175 An Interview with YouTube TE Apple Chow 181 Chapter 4: The Test Engineering Manager 187 The Life of a TEM 187 Getting Projects and People 189 Impact 191 An Interview with Gmail TEM Ankit Mehta 193 An Interview with Android TEM Hung Dang 198 An Interview with Chrome TEM Joel Hynoski 202 The Test Engineering Director 206 An Interview with Search and Geo Test Director Shelton Mar 207 An Interview with Engineering Tools Director Ashish Kumar 211 An Interview with Google India Test Director Sujay Sahni 214 An Interview with Engineering Manager Brad Green 219 An Interview with James Whittaker 222 Chapter 5: Improving How Google Tests Software 229 Fatal Flaws in Google´s Process 229 The Future of the SET 231 The Future of the TE 233 The Future of the Test Director and Manager 234 The Future of Test Infrastructure 234 In Conclusion 235 Appendix A: Chrome OS Test Plan 237 Overview of Themes 237 Risk Analysis 238 Per-Build Baseline Testing 239 Per-LKG Day Testing 239 Per-Release Testing 239 Manual Versus Automation 240 Dev Versus Test Quality Focus 240 Release Channels 240 User Input 241 Test Case Repositories 241 Test Dashboarding 241 Virtualization 241 Performance 242 Stress, Long-Running, and Stability 242 Test Execution Framework (Autotest) 242 OEMs 242 Hardware Lab 242 E2E Farm Automation 243 Testing the Browser AppManager 243 Browser Testability 243 Hardware 244 Timeline 244 Primary Test Drivers 246 Relevant Documents 246 Appendix B: Test Tours for Chrome 247 The Shopping Tour 247 The Student Tour 248 Suggested Areas to Test 248 The International Calling Tour 249 Suggested Areas to Test 249 The Landmark Tour 249 Suggested Landmarks in Chrome 249 The All Nighter Tour 250 Suggested Areas to Test 250 The Artisan´s Tour 251 Tools in Chrome 251 The Bad Neighborhood Tour 251 Bad Neighborhoods in Chrome OS 251 The Personalization Tour 252 Ways to Customize
A complete, start-to-finish guide to Google Analytics instrumentation and reporting Google Analytics Breakthrough is a much-needed comprehensive resource for the world´s most widely adopted analytics tool. Designed to provide a complete, best-practices foundation in measurement strategy, implementation, reporting, and optimization, this book systematically demystifies the broad range of Google Analytics features and configurations. Throughout the end-to-end learning experience, you´ll sharpen your core competencies, discover hidden functionality, learn to avoid common pitfalls, and develop next-generation tracking and analysis strategies so you can understand what is helping or hindering your digital performance and begin driving more success. Google Analytics Breakthrough offers practical instruction and expert perspectives on the full range of implementation and reporting skills: Learn how to campaign-tag inbound links to uncover the email, social, PPC, and banner/remarketing traffic hiding as other traffic sources and to confidently measure the ROI of each marketing channel Add event tracking to capture the many important user interactions that Google Analytics does not record by default, such as video plays, PDF downloads, scrolling, and AJAX updates Master Google Tag Manager for greater flexibility and process control in implementation Set up goals and Enhanced Ecommerce tracking to measure performance against organizational KPIs and configure conversion funnels to isolate drop-off Create audience segments that map to your audience constituencies, amplify trends, and help identify optimization opportunities Populate custom dimensions that reflect your organization, your content, and your visitors so Google Analytics can speak your language Gain a more complete view of customer behavior with mobile app and cross-device tracking Incorporate related tools and techniques: third-party data visualization, CRM integration for long-term value and lead qualification, marketing automation, phone conversion tracking, usability, and A/B testing Improve data storytelling and foster analytics adoption in the enterprise Millions of organizations have installed Google Analytics, including an estimated 67 percent of Fortune 500 companies, but deficiencies plague most implementations, and inadequate reporting practices continue to hinder meaningful analysis. By following the strategies and techniques in Google Analytics Breakthrough, you can address the gaps in your own still set, transcend the common limitations, and begin using Google Analytics for real competitive advantage. Critical contributions from industry luminaries such as Brian Clifton, Tim Ash, Bryan and Jeffrey Eisenberg, and Jim Sterne - and a foreword by Avinash Kaushik - enhance the learning experience and empower you to drive consistent, real-world improvement through analytics.
This book summary and analysis was created for individuals who want to extract the essential contents and are too busy to go through the full version. This book is not intended to replace the original book. Instead, we highly encourage you to buy the full version. John Doerr met with the founders of a startup to whom he gave $12.5 million in 1999. This was the biggest investment of his career. Larry Page and Sergey Brin had amazing technology, entrepreneurial energy, and great ambitions-but they had no real business plan. To change the world or even simply survive, Google had to make strong choices on priorities while keeping their team on track. They needed to know when to pull the plug or even fail fast. They needed timely, relevant data to monitor their progress-to measure what mattered. Doerr helped them with a proven approach to operating excellence: Objectives and Key Results. He discovered OKRs in the 1970s when he was an engineer at Intel, where Andy Grove, the greatest manager of his era, drove the amazingly run company. As a venture capitalist, Doerr shared Grove´s brainchild with more than fifty companies and whenever it was faithfully practiced, it worked. Objectives define what we want to achieve while key results are about how those goals will be attained through specific, measurable actions within a set time frame. Everyone´s goals-from entry-level to CEO are transparent to the whole company. Its benefits are profound as OKRs help with an organization´s most important work-they focus their effort and foster coordination. They help keep employees on track and they link objectives across teams to strengthen the entire company. OKRs eventually also improve workplace satisfaction and employee retention. Doerr shares a broad range of in-depth look into various companies including the Gates Foundation and Bono to show the focus, agility, and explosive growth that OKRs have created in the leading organizations. This book will create a new generation of leaders that capture the same magic. Wait no more, take action and get this book now!
The team behind ´How Google Works´ returns with management lessons from legendary coach and business executive, Bill Campbell, whose mentoring of some of our most successful modern entrepreneurs has helped create well over a trillion dollars in market value. Leaders at Google for over a decade, Eric Schmidt, Jonathan Rosenberg, and Alan Eagle have codified his wisdom in this essential guide.
Renowned futurist and celebrated international think-tank leader Greene offers a bracing look at how Google, Apple, Amazon, Facebook, and other Silicon Valley power players are using their influence across the globe to encroach upon our civil landscape.
From the ground-breaking offices of Google, ´´Search Inside Yourself´´ is a personal growth program that focuses on developing emotional intelligence through mindfulness, making its participants more productive at work and better leaders, while becoming more peaceful, happy and compassionate individuals. Famed for its innovative and unusual, yet highly successful working culture, Google is more than just a search engine. One such innovation is the ´´Search Inside Yourself´´ program which was created for Google in 2007 and has been taught there ever since, producing dramatic results. This book will show you how to apply the principles of ´´Search Inside Yourself´´ to you, your business and everyday life. Whether you are a junior team member or a senior manager, a secondary school teacher or a bus driver these valuable lessons have the potential to dramatically improve your life. Written by Chade-Meng Tan, the first engineer in Google´s history to leave the Engineering department and join their Peoples Ops Group, where he leads this and other personal-growth programs. It also includes a foreword by Daniel Goleman, the author of Emotional Intelligence and introduction from Jon Kabat-Zinn, author of Wherever You Go, There You Are. ´´This is a book offering much good advice. I most appreciate Meng´s insight that expressing compassion for others brings happiness to oneself as well.´´ Jimmy Carter, Former President of the United States ´´Google engineer, Chade-Meng Tan´s book shows that to avoid certain kinds of results, you need to change the conditions that give rise to them. If you change the habitual patterns of your mind, you can change their resulting attitudes and emotions and find peace and inner happiness.´´ His Holiness the Dalai Lama
Die Kraft einer Marke kommt immer von innen. Deshalb kann eine Marke nicht stark werden ohne Führungskräfte und Mitarbeiter, die die Marke leben. In markenspezifischer Führung stecken beträchtliche, aber meist ungenutzte Produktivitätsreserven eines Unternehmens. Dieses Buch führt den Leser Schritt für Schritt durch einen Leadership-Branding-Prozess und zeigt, wie Markenstrategie, Organisationsentwicklung, Führungsverständnis, Unternehmensstrategie und systemisches Management durch die Verschmelzung in Leadership Branding konkret anwendbar werden. Das Buch gibt Einblick in ein topaktuelles Thema, vermittelt Pionierwissen und macht deutlich, wie Führung produktiv wird. ´´Authentische glaubhafte Marken entstehen nur, wenn Markenwerte und internes Führungsverständnis im Einklang sind. Dieses Buch ist eine aufschlussreiche und lehrreiche Lektüre für alle, die Einfluss auf Markenführung, Unternehmensführung und Mitarbeiterführung haben.´´ Andreas Ronken, Geschäftsführer Ritter-Sport, Alfred Ritter GmbH & Co. KG ´´Die Verantwortung der Marke liegt heutzutage bei jedem einzelnen Mitarbeiter. Christina Grubendorfer greift mit Ihrem Buch ein Thema unserer Zeit auf: Ein markenspezifisches Führungsverständnis ist der Schlüssel für einen langfristigen Unternehmenserfolg!´´ Jens Monsees, Industry Leader, Consumer Goods & Healthcare, Google Germany GmbH ´´Strategie für die Zukunft: Steigern Sie Ihren Erfolg, lassen Sie Mitarbeiter die Werte Ihrer Marke endlich mit Leben füllen. Dieses Buch sagt Ihnen, wie es geht.´´ Axel Gloger, Wirtschaftsjournalist
Why can some organizations innovate time and again, while most cannot? You might think the key to innovation is attracting exceptional creative talent. Or making the right investments. Or breaking down organizational silos. All of these things may helpbut there´s only one way to ensure sustained innovation: you need to lead itand with a special kind of leadership. Collective Genius shows you how. Preeminent leadership scholar Linda Hill, along with former Pixar tech wizard Greg Brandeau, MIT researcher Emily Truelove, and Being the Boss coauthor Kent Lineback, found among leaders a widely shared, and mistaken, assumption: that a good´´ leader in all other respects would also be an effective leader of innovation. The truth is, leading innovation takes a distinctive kind of leadership, one that unleashes and harnesses the collective genius´´ of the people in the organization. Using vivid stories of individual leaders at companies like Volkswagen, Google, eBay, and Pfizer, as well as nonprofits and international government agencies, the authors show how successful leaders of innovation don´t create a vision and try to make innovation happen themselves. Rather, they create and sustain a culture where innovation is allowed to happen again and againan environment where people are both willing and able to do the hard work that innovative problem solving requires. Collective Genius will not only inspire you; it will give you the concrete, practical guidance you need to build innovation into the fabric of your business.