Sponsored Post: Etleap, PerfOps, InMemory.Net, Triplebyte, Stream, Scalyr
3 weeks ago, highscalability

Who's Hiring?  Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Make your job search O(1), not O(n). Apply here. Need excellent people? Advertise your job here!  Fun and Informative Events Advertise your event here! Cool Products and Services For heads of IT/Engineering responsible for building an analytics infrastructure, Etleap is an ETL solution for creating perfect data pipelines from ...

Stuff The Internet Says On Scalability For May 10th, 2019
1 month ago, highscalability

Wake up! It's HighScalability time:   Deep-sky mosaic, created from nearly 7,500 individual exposures, provides a wide portrait of the distant universe, containing 265,000 galaxies that stretch back through 13.3 billion years of time to just 500 million years after the big bang. (hubblesite)   Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon. I wrote Explain the Cloud Like I'm 10 for people who need to understand the cloud. And who doesn't these days? On Amazon it...

Stuff The Internet Says On Scalability For May 3rd, 2019
1 month ago, highscalability

Wake up! It's HighScalability time:   Event horizon? Nope. It's a close up of a security hologram. Makes one think.   Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon. I wrote Explain the Cloud Like I'm 10 for people who need to understand the cloud. And who doesn't these days? On Amazon it has 45 mostly 5 star reviews (105 on Goodreads). They'll learn a lot and hold you in awe.   Number Stuff: $1 trillion: Microsoft is the most valuable company in the world (fo...

Stuff The Internet Says On Scalability For April 26th, 2019
2 months ago, highscalability

Wake up! It's HighScalability time:   Found! The One Ring. In space!   Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon. I wrote Explain the Cloud Like I'm 10 for people who need to understand the cloud. And who doesn't these days? On Amazon it has 45 mostly 5 star reviews (103 on Goodreads). They'll learn a lot and hold you in even greater awe.   $30 million: Apple's per month AWS bill (a ~50% reduction); 73%: Azure YoY growth; 3,500: times per day andon cords a...

Stuff The Internet Says On Scalability For April 19th, 2019
2 months ago, highscalability

Wake up! It's HighScalability time:   Spirit? Smoke? Lightning? Nope. It's a gorgeous LIDAR image showing 1500 years of Willamette River movement (@Blacky_Himself)   Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon. I wrote Explain the Cloud Like I'm 10 for people who need to understand the cloud. And who doesn't these days? On Amazon it has 44 mostly 5 star reviews (102 on Goodreads). They'll learn a lot and hold you in awe.   536: IRS tax return submissions per...

MySQL High Availability Framework Explained – Part III: Failover Scenarios
2 months ago, highscalability

In this three-part blog series, we introduced a High Availability (HA) Framework for MySQL hosting in Part I, and discussed the details of MySQL semisynchronous replication in Part II. Now in Part III, we review how the framework handles some of the important MySQL failure scenarios and recovers to ensure high availability. MySQL Failover Scenarios Scenario 1 – Master MySQL Goes Down The Corosync and Pacemaker framework detects that the master MySQL is no longer available. Pacemaker demotes th...

Stuff The Internet Says On Scalability For April 12th, 2019
2 months ago, highscalability

Out sick today, but start saving up for that ticket to Mars (more):   ...

Sponsored Post: PerfOps, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr
2 months ago, highscalability

Who's Hiring?  Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Make your job search O(1), not O(n). Apply here. Need excellent people? Advertise your job here!  Fun and Informative Events Join Etleap, an Amazon Redshift ETL tool to learn the latest trends in designing a modern analytics infrastructure. Learn what has changed in the analytics landscape and how to avoid the major pitfalls whi...

From bare-metal to Kubernetes
2 months ago, highscalability

  This is a guest post by Hugues Alary, Lead Engineer at Betabrand,  a retail clothing company and crowdfunding platform, based in San Francisco. This article was originally published here.   Early infrastructure VPS Rackspace OVH Hardware infrastructure The scalability and maintainability issue Scaling development processes The advent of Docker Kubernetes Learning Kubernetes Officially migrating The development/staging environments A year after ...

Stuff The Internet Says On Scalability For April 5th, 2019
2 months ago, highscalability

Wake up! It's HighScalability time: SHUTDOWN ABORT the last Oracle database running Amazon Fulfillment! pic.twitter.com/DorqTua2Lt — John Darrow (@jdarrow) March 29, 2019   How unhappy do you have to be as a customer to take so much joy in end-of-lifing a product?   Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon. I wrote Explain the Cloud Like I'm 10 for people who need to understand the cloud. And who doesn't these days? On Amazon it has 44 mostly 5 star reviews...

2019 PostgreSQL Trends Report: Private vs. Public Cloud, Migrations, Database Combinations & Top Reasons Used
2 months ago, highscalability

PostgreSQL is an open source object-relational database system that has soared in popularity over the past 30 years from its active, loyal, and growing community. For the 2nd year in a row, PostgreSQL has kept the title of #1 fastest growing database in the world according to the DBMS of the Year report by the experts at DB-Engines. So what makes PostgreSQL so special, and how is it being used today? We found the answers at the Postgres Conference in March where we surveyed PostgreSQL users, co...

Stuff The Internet Says On Scalability For March 29th, 2019
2 months ago, highscalability

Wake up! It's HighScalability time:   Uber's microservice Graph. Thousands of microservices. Crazy like a fox? Or just crazy? (@msuriar)   Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon. I wrote Explain the Cloud Like I'm 10 for people who need to understand the cloud. And who doesn't these days? On Amazon it has 42 mostly 5 star reviews (100 on Goodreads). They'll learn a lot and love you for the hookup.   1.5 billion: monthly What's App users; 80 billion: doc...

Stuff The Internet Says On Scalability For March 22nd, 2019
3 months ago, highscalability

Wake up! It's HighScalability time:   Van Gogh? Nope. A satellite image of phytoplankton populations or algae blooms in the Baltic Sea. (NASA)   Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon. Know anyone who needs cloud? I wrote Explain the Cloud Like I'm 10 just for them. It has 41 mostly 5 star reviews. They'll learn a lot and love you even more.   .5 billion: weekly visits to Apple App store; $500m: new US exascale computer; $1.7 billion: EU's newest fine o...

Stuff The Internet Says On Scalability For March 15th, 2019
3 months ago, highscalability

Wake up! It's HighScalability time:   The web is 30! Some say it's not the web we wanted. But if we got that web, would it have ever grown so big? Worse usually is better.   Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon. Know anyone who needs cloud? I wrote Explain the Cloud Like I'm 10 just for them. It has 40 mostly 5 star reviews. They'll learn a lot and love you even more.   300%: AWS IoT growth per year; 74%: mobile games user spending in the App store; 3...

Stuff The Internet Says On Scalability For March 8th, 2019
3 months ago, highscalability

Wake up! It's HighScalability time:   A highly simplified diagram of serverless. (@jbesw)   Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon. Know anyone who needs cloud? I wrote Explain the Cloud Like I'm 10 just for them. It has 40 mostly 5 star reviews. They'll learn a lot and love you even more.   5%: France's new digital tax revolution; $15 trillion: AI contribution to global GDP by 2030; 70%: better response time using HTTP keep-alive in lambda; 115 million...

2019 Database Trends – SQL vs. NoSQL, Top Databases, Single vs. Multiple Database Use
3 months ago, highscalability

Wondering which databases are trending in 2019? We asked hundreds of developers, engineers, software architects, dev teams, and IT leaders at DeveloperWeek to discover the current NoSQL vs. SQL usage, most popular databases, important metrics to track, and their most time-consuming database management tasks. Get the latest insights on MySQL, MongoDB, PostgreSQL, Redis, and many others to see which database management systems are most favored this year. SQL vs. NoSQL ...

How is software developed at Amazon?
3 months ago, highscalability

  How is software developed at Amazon? Get a couple of prime pizzas delivered and watch this excellent interview with Ken Exner, GM of AWS Developer Tools. It's notable Ken is from the tools group, because progress in an industry is almost always made possible by the development of better tools. The key themes from the talk: decomposition, automation, and organize around the customer. The key idea: Scaling is by mitosis. Teams split apart into smaller teams that completely own a service. EC2 s...

Stuff The Internet Says On Scalability For March 1st, 2019
3 months ago, highscalability

Wake up! It's HighScalability time:   10 years of AWS architecture increasing simplicity or increasing complexity? (Michael Wittig)   Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon. Know anyone who needs cloud? I wrote Explain the Cloud Like I'm 10 just for them. It has 39 mostly 5 star reviews. They'll learn a lot and love you forever.   1.3 billion: npm package downloads per day; 20: honeybee communication signals used to coordinate thousands of workers; 71: ...

Give Meaning to 100 Billion Events a Day — The Shift to Redshift
3 months ago, highscalability

In part one, we described our Analytics data ingestion pipeline, with BigQuery sitting as our data warehouse. However, having our analytics events in BigQuery is not enough. Most importantly, data needs to be served to our end-users. TL;DR — Teads Analytics big picture In this article, we will detail: Why we chose Redshift to store our data marts, How it fits into our serving layer, Key learnings and optimization tips to make the most out of it, Orchestration workflows, How our data visua...

Design Of A Modern Cache—Part Deux
4 months ago, highscalability

This is a guest post by Benjamin Manes, who did engineery things for Google and is now doing engineery things as CTO of Vector. The previous article described the caching algorithms used by Caffeine, in particular the eviction and concurrency models. Since then we’ve made improvements to the eviction algorithm and explored a new approach towards expiration. Eviction Policy Window TinyLFU (W-TinyLFU) splits the policy into three parts: an admission window, a frequency filter, and the main region...

Next