Welcome to Nebula Documentation
Nebula is a massive scale container (Docker) management system that allows managing highly distributed systems (IoT/POS/edge computing/etc) in a workflow that's similar to other Docker orchestrator, this is achieved by following the linux method of doing one thing only, each component is designed to be able to scale out for as far as needed, only downside over standard container orchestrator is that this loads the same "pod" of containers on each server that is managed with the same APP_NAME list rather then dynamically mix and match different apps, so it can also be viewed\used like a great CI\CD (or even as puppet for docker hosts) for docker which allows deploying to thousands of servers simultaneously using a single API call.
- Change ports
- Change envvars
- Stop\start\restart\rolling restart containers
- Force pull updated containers
- Change # of containers running per core/instance
- Change image used
- Manage multiple apps over different worker servers, each server "pod" of apps is determined by what APP_NAME envvar value comma separated list you start the worker-manager container with, allowing you to mix and match for different worker clusters while still managing all of them from the same api-manager containers.
- Mount volumes
- Set containers with privileged permissions
- Mount devices
- Control containers network affiliation
There are 2 custom created services:
- api manager - a REST API endpoint to control nebula, fully stateless (all data stored in DB only).
- worker manager - a container which listens to rabbit and manages the worker server it runs on, one has to run on each worker, fully stateless.
As each worker server is in charge only of it's own containers all pulls from rabbit and work happens on the same time on all servers so pushing 50 million containers on a million servers will take roughly the same amount of time as pushing 50 containers on 1 server.
Example use cases
- Apps with resource and\or traffic requirements so massive other orchestrators can't handle (thousands of servers and\or tens or even hundreds of millions of requests)
- Managing apps that spans multiple regions and\or clouds from a single source with a single API call
- IOT\POS\client deployments - a rather inventive use case which can allow you to deploy a new version to all of your clients (even if they range in the thousands) appliances with a single API call in minutes
- SAAS providers - if you have a cluster per client (as you provide them with managed "private" instances) or such Nebula allows you to push new versions all your clients managed instances at once
- A form of docker configuration management, similar to docker-compose only it also pushes changes in configurations to all managed servers.
Repo folder structure
- api-manager - the api endpoint through which Nebula is controlled, includes api-manager Dockerfile & entire code structure
- docs - docs (schematics, wishlist\todo's, and API doc)
- worker-manager - the worker manager that manages individual Nebula workers, includes worker-manager Dockerfile & entire code structure
- nebula-python-sdk - a pythonic SDK for using Nebula
- nebula-cmd - a CLI for using Nebula
docker hub repos
- api-manager - prebuilt docker image of the api-manager
- worker-manager - prebuilt docker image of the worker-manager
- This is an open source project, see attached license for more details.
- The project is still rather young but that been said it's already in use in a production environment at vidazoo (Nebula was originally developed as an internal tool for vidazoo before being open sourced) for over a year in a multi cloud, multi region, high traffic (10 million+ requests/minute) environment with great success.
- Help is very much welcomed.
- Tested OS: CoreOS, RancherOS, Ubuntu server 14.04 & 16.04, CentOS 6 & 7, Amazon linux, expected to work with any Docker compatible Linux distro.
- Tested Docker versions: each Nebula version is tested on the latest Docker version at the time of it's release but any Docker version that has support for user networks should work with Nebula.
Attached are 3 example for you to draw inspiration from when designing yours, a more detailed explaination of it can be found at the architecture page: