• Computers

Monitoring with Ganglia

Tracking Dynamic Host and Application Metrics at Scale
Author: Matt Massie,Bernard Li,Brad Nicholes,Vladimir Vuksan,Robert Alexander,Jeff Buchbinder,Frederiko Costa,Alex Dean,Dave Josephsen,Peter Phaal,Daniel Pocock
Publisher: "O'Reilly Media, Inc."
ISBN: 1449330657
Category: Computers
Page: 256
View: 3750
Written by Ganglia designers and maintainers, this book shows you how to collect and visualize metrics from clusters, grids, and cloud infrastructures at any scale. Want to track CPU utilization from 50,000 hosts every ten seconds? Ganglia is just the tool you need, once you know how its main components work together. This hands-on book helps experienced system administrators take advantage of Ganglia 3.x. Learn how to extend the base set of metrics you collect, fetch current values, see aggregate views of metrics, and observe time-series trends in your data. You’ll also examine real-world case studies of Ganglia installs that feature challenging monitoring requirements. Determine whether Ganglia is a good fit for your environment Learn how Ganglia’s gmond and gmetad daemons build a metric collection overlay Plan for scalability early in your Ganglia deployment, with valuable tips and advice Take data visualization to a new level with gweb, Ganglia’s web frontend Write plugins to extend gmond’s metric-collection capability Troubleshoot issues you may encounter with a Ganglia installation Integrate Ganglia with the sFlow and Nagios monitoring systems Contributors include: Robert Alexander, Jeff Buchbinder, Frederiko Costa, Alex Dean, Dave Josephsen, Peter Phaal, and Daniel Pocock. Case study writers include: John Allspaw, Ramon Bastiaans, Adam Compton, Andrew Dibble, and Jonah Horowitz.


    • Computers

Monitoring with Graphite

Tracking Dynamic Host and Application Metrics at Scale
Author: Jason Dixon
Publisher: "O'Reilly Media, Inc."
ISBN: 1491916834
Category: Computers
Page: 290
View: 1713
Graphite has become one of the most powerful monitoring tools available today, due to its ease of use, rapid graph prototyping abilities, and a friendly rendering API. With this practical guide, system administrators and engineers will learn how to use this open source tool to track operational data you need to monitor your systems, as well as application-level metrics for profiling your services. Author Jason Dixon, member of the Graphite project, provides a thorough introduction of Graphite from the basics to the skills and tools you need for troubleshooting and scaling out its software components. If you want to learn more about monitoring systems, services, or applications, this is the book you need. Get an introduction to monitoring, including important concepts and terminology Examine the features and functionality of key Graphite components, including Carbon and Whisper Learn the typical user workflow necessary to create a basic line chart Build complex charts with chained functions and multiple axes that interact directly with the rendering API Understand how to use the native Graphite dashboard, as well as the more popular third-party dashboards Master the art of scaling and troubleshooting high-performance or highly available Graphite clusters

    • Computers

Hello, Startup

A Programmer's Guide to Building Products, Technologies, and Teams
Author: Yevgeniy Brikman
Publisher: "O'Reilly Media, Inc."
ISBN: 1491910046
Category: Computers
Page: 604
View: 4536
This book is the "Hello, World" tutorial for building products, technologies, and teams in a startup environment. It's based on the experiences of the author, Yevgeniy (Jim) Brikman, as well as interviews with programmers from some of the most successful startups of the last decade, including Google, Facebook, LinkedIn, Twitter, GitHub, Stripe, Instagram, AdMob, Pinterest, and many others. Hello, Startup is a practical, how-to guide that consists of three parts: Products, Technologies, and Teams. Although at its core, this is a book for programmers, by programmers, only Part II (Technologies) is significantly technical, while the rest should be accessible to technical and non-technical audiences alike. If you’re at all interested in startups—whether you’re a programmer at the beginning of your career, a seasoned developer bored with large company politics, or a manager looking to motivate your engineers—this book is for you.

    • Computers

Monitoring with Graphite

Tracking Dynamic Host and Application Metrics at Scale
Author: Jason Dixon
Publisher: "O'Reilly Media, Inc."
ISBN: 1491916834
Category: Computers
Page: 290
View: 5026
Graphite has become one of the most powerful monitoring tools available today, due to its ease of use, rapid graph prototyping abilities, and a friendly rendering API. With this practical guide, system administrators and engineers will learn how to use this open source tool to track operational data you need to monitor your systems, as well as application-level metrics for profiling your services. Author Jason Dixon, member of the Graphite project, provides a thorough introduction of Graphite from the basics to the skills and tools you need for troubleshooting and scaling out its software components. If you want to learn more about monitoring systems, services, or applications, this is the book you need. Get an introduction to monitoring, including important concepts and terminology Examine the features and functionality of key Graphite components, including Carbon and Whisper Learn the typical user workflow necessary to create a basic line chart Build complex charts with chained functions and multiple axes that interact directly with the rendering API Understand how to use the native Graphite dashboard, as well as the more popular third-party dashboards Master the art of scaling and troubleshooting high-performance or highly available Graphite clusters

    • Computers

The Art of Capacity Planning

Scaling Web Resources
Author: John Allspaw
Publisher: "O'Reilly Media, Inc."
ISBN: 0596551835
Category: Computers
Page: 156
View: 3540
Success on the web is measured by usage and growth. Web-based companies live or die by the ability to scale their infrastructure to accommodate increasing demand. This book is a hands-on and practical guide to planning for such growth, with many techniques and considerations to help you plan, deploy, and manage web application infrastructure. The Art of Capacity Planning is written by the manager of data operations for the world-famous photo-sharing site Flickr.com, now owned by Yahoo! John Allspaw combines personal anecdotes from many phases of Flickr's growth with insights from his colleagues in many other industries to give you solid guidelines for measuring your growth, predicting trends, and making cost-effective preparations. Topics include: Evaluating tools for measurement and deployment Capacity analysis and prediction for storage, database, and application servers Designing architectures to easily add and measure capacity Handling sudden spikes Predicting exponential and explosive growth How cloud services such as EC2 can fit into a capacity strategy In this book, Allspaw draws on years of valuable experience, starting from the days when Flickr was relatively small and had to deal with the typical growth pains and cost/performance trade-offs of a typical company with a Web presence. The advice he offers in The Art of Capacity Planning will not only help you prepare for explosive growth, it will save you tons of grief.

    • Computers

Web Operations

Keeping the Data On Time
Author: John Allspaw,Jesse Robbins
Publisher: "O'Reilly Media, Inc."
ISBN: 9781449394158
Category: Computers
Page: 338
View: 6473
A web application involves many specialists, but it takes people in web ops to ensure that everything works together throughout an application's lifetime. It's the expertise you need when your start-up gets an unexpected spike in web traffic, or when a new feature causes your mature application to fail. In this collection of essays and interviews, web veterans such as Theo Schlossnagle, Baron Schwartz, and Alistair Croll offer insights into this evolving field. You'll learn stories from the trenches--from builders of some of the biggest sites on the Web--on what's necessary to help a site thrive. Learn the skills needed in web operations, and why they're gained through experience rather than schooling Understand why it's important to gather metrics from both your application and infrastructure Consider common approaches to database architectures and the pitfalls that come with increasing scale Learn how to handle the human side of outages and degradations Find out how one company avoided disaster after a huge traffic deluge Discover what went wrong after a problem occurs, and how to prevent it from happening again Contributors include: John Allspaw Heather Champ Michael Christian Richard Cook Alistair Croll Patrick Debois Eric Florenzano Paul Hammond Justin Huff Adam Jacob Jacob Loomis Matt Massie Brian Moon Anoop Nagwani Sean Power Eric Ries Theo Schlossnagle Baron Schwartz Andrew Shafer

    • Computers

Hadoop: The Definitive Guide


Author: Tom White
Publisher: "O'Reilly Media, Inc."
ISBN: 1449338771
Category: Computers
Page: 688
View: 5023
Ready to unlock the power of your data? With this comprehensive guide, you’ll learn how to build and maintain reliable, scalable, distributed systems with Apache Hadoop. This book is ideal for programmers looking to analyze datasets of any size, and for administrators who want to set up and run Hadoop clusters. You’ll find illuminating case studies that demonstrate how Hadoop is used to solve specific problems. This third edition covers recent changes to Hadoop, including material on the new MapReduce API, as well as MapReduce 2 and its more flexible execution model (YARN). Store large datasets with the Hadoop Distributed File System (HDFS) Run distributed computations with MapReduce Use Hadoop’s data and I/O building blocks for compression, data integrity, serialization (including Avro), and persistence Discover common pitfalls and advanced features for writing real-world MapReduce programs Design, build, and administer a dedicated Hadoop cluster—or run Hadoop in the cloud Load data from relational databases into HDFS, using Sqoop Perform large-scale data processing with the Pig query language Analyze datasets with Hive, Hadoop’s data warehousing system Take advantage of HBase for structured and semi-structured data, and ZooKeeper for building distributed systems

    • Computers

Hadoop Operations

A Guide for Developers and Administrators
Author: Eric Sammer
Publisher: "O'Reilly Media, Inc."
ISBN: 144932729X
Category: Computers
Page: 298
View: 8238
If you’ve been asked to maintain large and complex Hadoop clusters, this book is a must. Demand for operations-specific material has skyrocketed now that Hadoop is becoming the de facto standard for truly large-scale data processing in the data center. Eric Sammer, Principal Solution Architect at Cloudera, shows you the particulars of running Hadoop in production, from planning, installing, and configuring the system to providing ongoing maintenance. Rather than run through all possible scenarios, this pragmatic operations guide calls out what works, as demonstrated in critical deployments. Get a high-level overview of HDFS and MapReduce: why they exist and how they work Plan a Hadoop deployment, from hardware and OS selection to network requirements Learn setup and configuration details with a list of critical properties Manage resources by sharing a cluster across multiple groups Get a runbook of the most common cluster maintenance tasks Monitor Hadoop clusters—and learn troubleshooting with the help of real-world war stories Use basic tools and techniques to handle backup and catastrophic failure

    • Computers

Expert Hadoop Administration

Managing, Tuning, and Securing Spark, YARN, and HDFS
Author: Sam R. Alapati
Publisher: Addison-Wesley Professional
ISBN: 0134703383
Category: Computers
Page: 848
View: 9543
This is the eBook of the printed book and may not include any media, website access codes, or print supplements that may come packaged with the bound book. The Comprehensive, Up-to-Date Apache Hadoop Administration Handbook and Reference “Sam Alapati has worked with production Hadoop clusters for six years. His unique depth of experience has enabled him to write the go-to resource for all administrators looking to spec, size, expand, and secure production Hadoop clusters of any size.” —Paul Dix, Series Editor In Expert Hadoop® Administration, leading Hadoop administrator Sam R. Alapati brings together authoritative knowledge for creating, configuring, securing, managing, and optimizing production Hadoop clusters in any environment. Drawing on his experience with large-scale Hadoop administration, Alapati integrates action-oriented advice with carefully researched explanations of both problems and solutions. He covers an unmatched range of topics and offers an unparalleled collection of realistic examples. Alapati demystifies complex Hadoop environments, helping you understand exactly what happens behind the scenes when you administer your cluster. You’ll gain unprecedented insight as you walk through building clusters from scratch and configuring high availability, performance, security, encryption, and other key attributes. The high-value administration skills you learn here will be indispensable no matter what Hadoop distribution you use or what Hadoop applications you run. Understand Hadoop’s architecture from an administrator’s standpoint Create simple and fully distributed clusters Run MapReduce and Spark applications in a Hadoop cluster Manage and protect Hadoop data and high availability Work with HDFS commands, file permissions, and storage management Move data, and use YARN to allocate resources and schedule jobs Manage job workflows with Oozie and Hue Secure, monitor, log, and optimize Hadoop Benchmark and troubleshoot Hadoop

    • Computers

Deploying Rails

Automate, Deploy, Scale, Maintain, and Sleep at Night
Author: Anthony Burns,Tom Copeland
Publisher: N.A
ISBN: 9781934356951
Category: Computers
Page: 217
View: 8862
Today's modern Rails applications have lots of moving parts. Make sure your next production deployment goes smoothly with this hands-on book, which guides you through the entire production process. You'll set up scripts to install and configure all the software your servers need, including your application code. Once you're in production, you'll learn how to set up systems to monitor your application's health, gather metrics so you can stop problems before they start, and fix things when they go wrong. Deploying Rails takes you on a expertly guided tour of the current best practices in Rails deployment and management. You'll find in-depth explanations on effectively running a Rails app by leveraging popular open source tools such as Puppet, Capistrano, and Vagrant. Then you'll go beyond deployment and learn how to use Ganglia and Nagios to monitor your application's health and gather metrics so you can head off problems before they happen. You'll start out by building your own virtual environment by writing scripts to provision a production server with Vagrant and Puppet. Then you'll leverage the popular Rails deployment tool Capistrano to deploy an application into this infrastructure. Once the app is live, you'll monitor your application's health with Nagios, and configure Ganglia to collect system metrics. Finally, you'll see how to keep your data backed up, recover data when things go wrong, tame your log files, and use Puppet to automate everything along the way. Whether you're a Rails developer who wants a better understanding of the needs of a production Rails system, if you're a system administrator who wants to manage a Rails application, or if you're bridging the gap between development and operations, this book will be your roadmap to successful production deployment and maintenance, whether your application has ten users or ten million users. What You Need: The exercises and examples are most suited to a computer running some Unix variant, such as Mac OS X or Linux. But a Windows machine running Linux in a VirtualBox virtual machine is also sufficient. We'll show you how to set up a local virtual machine for your deployments; you won't need a dedicated server to hone your deployment skills. We expect you to have a basic familiarity with the Ruby programming language, the Ruby on Rails framework, and the Unix command line.

    • Computers

Modern Linux Administration

How to Become a Cutting-Edge Linux Administrator
Author: Sam R. Alapati,Matt Stratton
Publisher: O'Reilly Media
ISBN: 9781491935958
Category: Computers
Page: 500
View: 9035
If you want to excel in your work as a Linux administrator, or perhaps land a job as one, you need this book. The amount of knowledge and expertise required of Linux administrators has grown tremendously over the past 10 years. Today you need an amazing variety of skills, several of them very new. This book provides developers, enterprise architects, and site reliability engineers with a sound introduction to bleeding-edge Linux-based tools and technologies for both development and production environments. If you already know Linux administration basics, author Sam Alapati will help you explore and evaluate tools for virtualization, cloud and big data, configuration management and continuous delivery, and operations monitoring. Topics include: Scalability, web applications, web services, and microservices Server virtualization, Linux containers, and Docker containers Automating server deployment and managing development environments Infrastructure as code, configuration management, and orchestration tools Version control and source code management Continuous integration, continuous delivery, and continuous deployment Centralized log management and analysis, and streaming data

    • Computers

Proceedings of the 3rd International Symposium on Big Data and Cloud Computing Challenges (ISBCC – 16’)


Author: V. Vijayakumar,V. Neelanarayanan
Publisher: Springer
ISBN: 3319303481
Category: Computers
Page: 520
View: 7124
This proceedings volume contains selected papers that were presented in the 3rd International Symposium on Big data and Cloud Computing Challenges, 2016 held at VIT University, India on March 10 and 11. New research issues, challenges and opportunities shaping the future agenda in the field of Big Data and Cloud Computing are identified and presented throughout the book, which is intended for researchers, scholars, students, software developers and practitioners working at the forefront in their field. This book acts as a platform for exchanging ideas, setting questions for discussion, and sharing the experience in Big Data and Cloud Computing domain.​

    • Computers

SAP Applications on IBM PowerVM


Author: Irene Hopf,Christian Bartels,Elmar Billen,James Nugen,Walter Orb,Olaf Rutz,IBM Redbooks
Publisher: IBM Redbooks
ISBN: 0738436046
Category: Computers
Page: 194
View: 9621
IBM® invented the virtualization technology starting in the 1960s on the mainframe, and the functionalities evolved and were ported to other platforms and improved the reliability, availability, and serviceability (RAS) features. With virtualization, you achieve better asset utilization, reduced operating costs, and faster responsiveness to changing business demands. Every technology vendor in the SAP ecosystem understands virtualization as slightly different capabilities on different levels (storage and server hardware, processor, memory, I/O resources or the application, and so on). It is important to understand exactly what functionality is offered and how it supports the client's business requirements. In this IBM Redbooks® publication we focus on server virtualization technologies in the IBM Power SystemsTM hardware, AIX®, IBM i, and Linux space and what they mean specifically for SAP applications running on this platform. SAP clients can leverage the technology that the IBM Power Systems platform offers. In this book, we describe the technologies and functions, what they mean, and how they apply to the SAP system landscape.

    • Computers

Performance and Capacity Implications for Big Data


Author: Dave Jewell,Ricardo Dobelin Barros,Stefan Diederichs,Lydia M. Duijvestijn,Michael Hammersley,Arindam Hazra,Corneliu Holban,Yan Li,Osai Osaigbovo,Andreas Plach,Ivan Portilla,Mukerji Saptarshi,Harinder P. Seera,Elisabeth Stahl,Clea Zolotow,IBM Redbooks
Publisher: IBM Redbooks
ISBN: 0738453587
Category: Computers
Page: 46
View: 393
Big data solutions enable us to change how we do business by exploiting previously unused sources of information in ways that were not possible just a few years ago. In IBM® Smarter Planet® terms, big data helps us to change the way that the world works. The purpose of this IBM RedpaperTM publication is to consider the performance and capacity implications of big data solutions, which must be taken into account for them to be viable. This paper describes the benefits that big data approaches can provide. We then cover performance and capacity considerations for creating big data solutions. We conclude with what this means for big data solutions, both now and in the future. Intended readers for this paper include decision-makers, consultants, and IT architects.

    • Computers

IBM InfoSphere Streams Harnessing Data in Motion


Author: Chuck Ballard,Daniel M Farrell,Mark Lee,Paul D Stone,Scott Thibault,Sandra Tucker,IBM Redbooks
Publisher: IBM Redbooks
ISBN: 0738434736
Category: Computers
Page: 360
View: 5202
In this IBM® Redbooks® publication, we discuss and describe the positioning, functions, capabilities, and advanced programming techniques for IBM InfoSphereTM Streams (V1). See: http://www.redbooks.ibm.com/abstracts/sg247970.html for the newer InfoSphere Streams (V2) release. Stream computing is a new paradigm. In traditional processing, queries are typically run against relatively static sources of data to provide a query result set for analysis. With stream computing, a process that can be thought of as a continuous query, that is, the results are continuously updated as the data sources are refreshed. So, traditional queries seek and access static data, but with stream computing, a continuous stream of data flows to the application and is continuously evaluated by static queries. However, with IBM InfoSphere Streams, those queries can be modified over time as requirements change. IBM InfoSphere Streams takes a fundamentally different approach to continuous processing and differentiates itself with its distributed runtime platform, programming model, and tools for developing continuous processing applications. The data streams consumable by IBM InfoSphere Streams can originate from sensors, cameras, news feeds, stock tickers, and a variety of other sources, including traditional databases. It provides an execution platform and services for applications that ingest, filter, analyze, and correlate potentially massive volumes of continuous data streams.

    • Medical

Night Noise Guidelines for Europe


Author: Who Regional Office for Europe
Publisher: WHO Regional Office Europe
ISBN: 9289041730
Category: Medical
Page: 162
View: 1776
Environmental noise is a threat to public health, having negative impacts on human health and wellbeing. This book reviews the health effects of night time noise exposure, examines dose-effects relations, and presents interim and ultimate guideline values of night noise exposure. It offers guidance to the policy-makers in reducing the health impacts of night noise, based on expert evaluation of scientific evidence in Europe.The review of scientific evidence and the derivation of guideline values were conducted by outstanding scientists. The contents of the document were peer-reviewed and discussed for a consensus among the experts and the stakeholders. We are thankful for those who contributed to the development and presentation of this guidelines and believe that this work will contribute to improving the health of the people in the Region.

    • Medical

Textbook of Neural Repair and Rehabilitation


Author: Michael Selzer,Stephanie Clarke,Leonardo Cohen,Gert Kwakkel,Robert Miller
Publisher: Cambridge University Press
ISBN: 110701168X
Category: Medical
Page: 760
View: 8068
Volume 2 of the Textbook of Neural Repair and Rehabilitation stands alone as a clinical handbook for neurorehabilitation.

    • Computers

Middleware 2012

ACM/IFIP/USENIX 13th International Middleware Conference, Montreal, Canada, December 3-7, 2012. Proceedings
Author: Priya Narasimhan,Peter Triantafillou
Publisher: Springer
ISBN: 3642351700
Category: Computers
Page: 498
View: 2373
This book constitutes the refereed proceedings of the ACM/IFIP/USENIX 13th International Middleware Conference, held in Montreal, Canada, in December 2012. The 24 revised full papers presented were carefully reviewed and selected from 125 submissions. The papers are organized in topical sections on mobile middleware; tracing and diagnosis; architecture and performance; publish/subscribe middleware; and big-data and cloud computing; availability, security and privacy.

    • Computers

Enterprise Integration Patterns

Designing, Building, and Deploying Messaging Solutions
Author: Gregor Hohpe,Bobby Woolf
Publisher: Addison-Wesley
ISBN: 0133065103
Category: Computers
Page: 735
View: 5588
Enterprise Integration Patterns provides an invaluable catalog of sixty-five patterns, with real-world solutions that demonstrate the formidable of messaging and help you to design effective messaging solutions for your enterprise. The authors also include examples covering a variety of different integration technologies, such as JMS, MSMQ, TIBCO ActiveEnterprise, Microsoft BizTalk, SOAP, and XSL. A case study describing a bond trading system illustrates the patterns in practice, and the book offers a look at emerging standards, as well as insights into what the future of enterprise integration might hold. This book provides a consistent vocabulary and visual notation framework to describe large-scale integration solutions across many technologies. It also explores in detail the advantages and limitations of asynchronous messaging architectures. The authors present practical advice on designing code that connects an application to a messaging system, and provide extensive information to help you determine when to send a message, how to route it to the proper destination, and how to monitor the health of a messaging system. If you want to know how to manage, monitor, and maintain a messaging system once it is in use, get this book.