Stuff The Internet Says On Scalability For March 15th, 2019
6 days ago, highscalability

Wake up! It's HighScalability time:   The web is 30! Some say it's not the web we wanted. But if we got that web, would it have ever grown so big? Worse usually is better.   Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon. Know anyone who needs cloud? I wrote Explain the Cloud Like I'm 10 just for them. It has 40 mostly 5 star reviews. They'll learn a lot and love you even more.   300%: AWS IoT growth per year; 74%: mobile games user spending in the App store; 3...

Stuff The Internet Says On Scalability For March 8th, 2019
1 week ago, highscalability

Wake up! It's HighScalability time:   A highly simplified diagram of serverless. (@jbesw)   Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon. Know anyone who needs cloud? I wrote Explain the Cloud Like I'm 10 just for them. It has 40 mostly 5 star reviews. They'll learn a lot and love you even more.   5%: France's new digital tax revolution; $15 trillion: AI contribution to global GDP by 2030; 70%: better response time using HTTP keep-alive in lambda; 115 million...

2019 Database Trends – SQL vs. NoSQL, Top Databases, Single vs. Multiple Database Use
2 weeks ago, highscalability

Wondering which databases are trending in 2019? We asked hundreds of developers, engineers, software architects, dev teams, and IT leaders at DeveloperWeek to discover the current NoSQL vs. SQL usage, most popular databases, important metrics to track, and their most time-consuming database management tasks. Get the latest insights on MySQL, MongoDB, PostgreSQL, Redis, and many others to see which database management systems are most favored this year. SQL vs. NoSQL ...

How is software developed at Amazon?
2 weeks ago, highscalability

  How is software developed at Amazon? Get a couple of prime pizzas delivered and watch this excellent interview with Ken Exner, GM of AWS Developer Tools. It's notable Ken is from the tools group, because progress in an industry is almost always made possible by the development of better tools. The key themes from the talk: decomposition, automation, and organize around the customer. The key idea: Scaling is by mitosis. Teams split apart into smaller teams that completely own a service. EC2 s...

Stuff The Internet Says On Scalability For March 1st, 2019
2 weeks ago, highscalability

Wake up! It's HighScalability time:   10 years of AWS architecture increasing simplicity or increasing complexity? (Michael Wittig)   Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon. Know anyone who needs cloud? I wrote Explain the Cloud Like I'm 10 just for them. It has 39 mostly 5 star reviews. They'll learn a lot and love you forever.   1.3 billion: npm package downloads per day; 20: honeybee communication signals used to coordinate thousands of workers; 71: ...

Give Meaning to 100 Billion Events a Day — The Shift to Redshift
3 weeks ago, highscalability

In part one, we described our Analytics data ingestion pipeline, with BigQuery sitting as our data warehouse. However, having our analytics events in BigQuery is not enough. Most importantly, data needs to be served to our end-users. TL;DR — Teads Analytics big picture In this article, we will detail: Why we chose Redshift to store our data marts, How it fits into our serving layer, Key learnings and optimization tips to make the most out of it, Orchestration workflows, How our data visua...

Design Of A Modern Cache—Part Deux
3 weeks ago, highscalability

This is a guest post by Benjamin Manes, who did engineery things for Google and is now doing engineery things as CTO of Vector. The previous article described the caching algorithms used by Caffeine, in particular the eviction and concurrency models. Since then we’ve made improvements to the eviction algorithm and explored a new approach towards expiration. Eviction Policy Window TinyLFU (W-TinyLFU) splits the policy into three parts: an admission window, a frequency filter, and the main region...

Stuff The Internet Says On Scalability For February 22nd, 2019
3 weeks ago, highscalability

Wake up! It's HighScalability time:   Isn't inetd a better comp? (link)   Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon. Know anyone who needs cloud? I wrote Explain the Cloud Like I'm 10 just for them. It has 39 mostly 5 star reviews. They'll learn a lot and love you forever.   2%: of sales spent by consumer packaged goods companies on R&D (14% for tech); 272 million: metric tons of plastic are produced each year around the globe; 100+ fps: Google's Edge TPU...

Intro to Redis Cluster Sharding – Advantages, Limitations, Deploying & Client Connections
1 month ago, highscalability

Redis Cluster is the native sharding implementation available within Redis that allows you to automatically distribute your data across multiple nodes without having to rely on external tools and utilities. At ScaleGrid, we recently added support for Redis Clusters on our platform through our fully managed Redis hosting plans. In this post, we’re going to introduce you to the advanced Redis Cluster sharding opportunities, discuss its advantages and limitations, when you should deploy, and how t...

Stuff The Internet Says On Scalability For February 15th, 2019
1 month ago, highscalability

Wake up! It's HighScalability time:   Opportunity crossed over the rainbow bridge after 15 years of loyal service. "Our beloved Opportunity remains silent."    Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon. Know anyone who needs cloud? I wrote Explain the Cloud Like I'm 10 just for them. It has 39 mostly 5 star reviews. They'll learn a lot and love you forever.   200 million: per day YouTube videos recommended on home page; $9.3 billion: 27% increase in AI fun...

Stuff The Internet Says On Scalability For February 8th, 2019
1 month ago, highscalability

Wake up! It's HighScalability time:   Change is always changing. What will the next 5 years look like?   Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon. Know anyone who needs cloud? I wrote Explain the Cloud Like I'm 10 just for them. It has 35 mostly 5 star reviews. They'll learn a lot and love you forever.   16,000: Chrome bugs found with ClusterFuzz;  $2,000,000: for Apple iOS remote jailbreak; $1 million: think twice when profiting from a bug; 0: clicks to ...

Stuff The Internet Says On Scalability For February 1st, 2019
1 month ago, highscalability

Wake up! It's HighScalability time:   Memory module for the Apollo Guidance Computer (Mike Stewart). The AGC weighed 70 pounds and had 2048 words of RAM in erasable core memory and 36,864 words of ROM in core rope memory. It flew to the moon.   Do you like this sort of Stuff? Please go to Patreon and do what comes natural. Need cloud? Stand under Explain the Cloud Like I'm 10 (35 nearly 5 star reviews).   $10.9B: Apple's Q1 services revenue;  5 million: homes on Airbnb; 2.5-5%: base64 gzipped...

A Hybrid Cloud Approach from FraudGuard.io that Handles 50M Requests a Day
1 month ago, highscalability

div align="center"> This is a guest post from Ryan Averill at FraudGuard.io. At FraudGuard.io we are a team of just a few developers; all working with our customers to try to make their applications as safe as possible. We have been working on FraudGuard for about 3 years and we’ve had paying customers for more than 2 years now. The main idea behind FraudGuard is for us to get attacked so you don’t have to. In other words; reduce the overall number of attacks your application receives each day...

Stuff The Internet Says On Scalability For January 25th, 2019
1 month ago, highscalability

Wake up! It's HighScalability time:   My god, it's full of synapses! (3D map of a fly's brain)   Do you like this sort of Stuff? Please go to Patreon and do what comes natural. Need cloud? Stand under Explain the Cloud Like I'm 10 (35 nearly 5 star reviews).   10%: Netflix captured screen time in US; 8.3 million: concurrent Fortnite players;  773 Million: Record "Collection #1" Data Breach; 284M+: Reddit monthly views; 1 billion: people impacted by data breaches; 1st: seed germinated on the m...

Sponsored Post: Software Buyers Council, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr
2 months ago, highscalability

Who's Hiring?  Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Make your job search O(1), not O(n). Apply here. Need excellent people? Advertise your job here!  Fun and Informative Events Advertise your event here! Cool Products and Services Shape the future of software in your industry. The Software Buyers Council is a panel of engineers and managers who want to share expert knowledge,...

Stuff The Internet Says On Scalability For January 18th, 2019
2 months ago, highscalability

Sorry, Stuff The Internet Says On Scalability has been called on the account of wind, rain, power outages and general mayhem. We're all safe, but it's hard to write a post using stone knives and bear skins. See you next week.     Lots of rain fell over the last 48 hours, but how much? Here is a preliminary look. For a more detailed list go here: https://t.co/4FDJ80jb8q #cawx #AtmosphericRiver pic.twitter.com/DjCIH1E9fn — NWS Bay Area (@NWSBayArea) January 17, 2019 Mudslide closes Hwy. 17 so...

Stuff The Internet Says On Scalability For January 11th, 2019
2 months ago, highscalability

Wake up! It's HighScalability time:   The modern day inner sanctum revealed for all to experience. Nausea no extra charge.   Do you like this sort of Stuff? Please support me on Patreon. Need cloud? Consume Explain the Cloud Like I'm 10 (35 nearly 5 star reviews).   8x: V8 Promiss.all parallel performance improvement;  1.3%: print sales increase; 11%: over 65 shared a hoax; 40%: add jobs after deploying AI; 3%: Eventbot's revenue pledged to open source; 51%: successful Ethereum attack; $308,6...

MySQL High Availability Framework Explained – Part II
2 months ago, highscalability

In Part I, we introduced a High Availability (HA) framework for MySQL hosting and discussed various components and their functionality. Now in Part II, we will discuss the details of MySQL semisynchronous replication and the related configuration settings that help us ensure redundancy and consistency of the data in our HA setup. Make sure to check back in for Part III where we will review various failure scenarios that could arise and the way the framework responds and recovers from these condi...

Slow MySQL Start Time in GTID mode? Binary Log File Size May Be The Issue
2 months ago, highscalability

Have you been experiencing slow MySQL startup times in GTID mode? We recently ran into this issue on one of our MySQL hosting deployments and set out to solve the problem. In this blog, we break down the issue that could be slowing down your MySQL restart times, how to debug for your deployment, and what you can do to decrease your start time and improve your understanding of GTID-based replication. How We Found The Problem ...

How DevOps Should Use DBaaS (Database-as-a-Service) To Optimize Their Application Development
2 months ago, highscalability

This post was written by Wendy Dessler of The Blog Frog. Database-as-a-Service (DBaaS) is quickly gaining in popularity across the tech world. These software platform solutions helps users easily manage their database operations without having to really understand any of the abstractions. This allows developers, DBA’s and DevOps engineers to quickly automate their backups, create new SQL and NoSQL clusters, and monitor the performance of their databases for their application without requiring an...

Next