TL;DR: Dealing with over 50 million records in a single table presents a significant challenge in managing data effectively. Problem Assessment The current company I’m working for manages tons of data. We rely on a range of storage options, using SQL Databases predominantly to capitalize on their potent features. Postgres which is…

This article continues my series of answering interview questions for applied Node.js engineers. You might be here to prepare yourself for the interview and you can definitely do this with this question. The material here is for testing any level of applied Node.js engineer therefore you can use them as…

The job interview process can be a hard and stressful experience in today’s competitive job market. Consequently, the more you prepare, the easier it becomes to ace the interview and consequently enhance your engineering knowledge. Navigating through various resources, I accidentally came across some impressive Node.js interview questions, meticulously compiled…

Introduction Establishing cross-account access for DynamoDB can be a complex task, particularly when navigating the intricacies of configuring multiple AWS accounts. However, by employing the power of Terraform and Node.js, you can overcome this challenge and create a robust and efficient multi-account setup. In this article, we will guide you through…

Problem Let's consider such a case — you are developing functionality that processes thousands of records in any data storage and your weapon of choice is the AWS Step Function service. One of the most powerful tools you can use there is Map task type since there you can maximize your…

All of us love working with Postgres. It’s a powerful database with lots of functionality. You can write very complex queries that would join, and group many tables. I guess with great power comes great responsibility and the bigger the project gets the easier it is to break something. …

Elasticsearch is an excellent tool for indexing large amounts of static data to perform searches and many other analytical queries. Whether you are a data scientist, an engineer, or simply someone who is interested in gaining a better understanding of your data, Elastic aggregations provide a powerful and flexible toolset…

Intro I guess you are probably using Elasticsearch or planning to since you've opened this article 🙂 Another assumption - you definitely found it a great idea to lock your functionality with some integration tests. And it really is! The current company I’m working for has 90+% of code coverage with…

Table of contents · Intro · Setup · Testing — 1 million records update · More realistic example — 10m · How can we improve this result? · Additional hacks · Updating whole collection — 63m · Remedy for the cursor · Wrap up Intro Following my previous article, we already have a 63🍋…