Nanoservice with V8 isolate

“Nanoservice with V8 isolate”. Generate with ChatGPT and served by author

As you may know, V8, an open-source high-performance JavaScript and WebAssembly engine, offers many advanced features that are useful in modern application service architecture

However, most of us are only familiar with a few of its features. To improve our application development experience, I’d like to introduce a feature in V8 that can broaden our architectural perspective and provide more creative insights into software architecture.

V8 Isolate

Is the main topic of what we gonna talk about today. It is an isolated execution environment with its own independent heap memory and garbage collector.”

As a result, these environments do not affect each other, ensuring that all individual executions operate independently.

It is also used in Worker Threads, a Node.js feature for multi-threading.

Multi-thread environment

This represents a traditional multi-threading architecture. The main process creates threads and allocates CPU resources to them. As we know, this allows for parallel execution.

The next drawing explains an architecture of V8-isolate in single-thread environment.

V8-Isolate in Single Thread environment

Similar to multi-threading architecture, it generates an independent execution environment.

However, these environments created by the main logic using V8 isolates are executed within the same process on a single CPU. Asynchronous libraries or features used by the main logic (such as Tokio, asyncio, etc.) control all the isolates efficiently.

Since these environments share a single CPU, most use cases for V8 isolates involve executing lightweight JavaScript code bundles. Many lightweight code bundles are executed in numerous small V8 isolate environments that start up and shut down very quickly.

Nanoservice

Finally, let’s discuss the concept of ‘Nanoservice’. In nanoservice architecture, many operations are executed within a single process using only one CPU.

Cloudflare, which has a high-quality use case for Nanoservice using V8 isolates, states that they created a V8 isolate wrapper for additional security and stability. Therefore, they ensured that each operations in same process are executed with minimal overhead.

You can check more information about Cloudflare Workers, a fully Nanoservice architectured API that serves Cloudflare’s services as below.

• Fine-Grained Sandboxing with V8 Isolates
• How Workers works
• Introducing workerd: the Open Source Workers runtime

In these articles, Cloudflare says that “Some in the industry prefer to call nanoservices ‘functions’”. It works more like functions or procedures since all lightweight code should work with small bundles (not a huge application logic). And we should ensure that each functions(isolated code bundles) are simple and streamlined that everyone can understand it easily with step by step.

RPC-like API

It may resemble an RPC-style API more than a REST-style one. We define what each function does in route path as an action, so user can explicitly understand and use each route in right situation.

The important thing is, all operations are executed in fully isolated environment so we can ensure the result of action in 100%! And we also do not need that much process since millions of lightweight operations can be executed in only one process. It cuts down cold start counts significantly in serverless environment and serve responses more faster than before.

That ‘s the summary of what I wanna introduce today about Nanoservice and V8 isolate.

If you are excited, just use it and experience a new paradigm of architecture!