aicra/README.md

18 KiB
Raw Blame History

| aicra |

Go version License: MIT Go Report Card Go doc

Aicra is a configuration-driven REST API engine in Go that allows you to create a fully featured API.

The whole API management is done for you from a configuration file describing your API, you just need to implement :

  • the controllers
  • the middle-wares (e.g. authentication, csrf)
  • and optionnally the type checkers to check if input values follows some rules

There is 2 available drivers that will load your implementations. The plugin driver is for Go programmers, the generic one is for any language (it uses standard input and output).

The engine has been designed with the following concepts in mind.

concept explanation
meaningful defaults Defaults and default values work without further understanding
configuration driven Avoid information duplication. Automate anything that can be automated without losing control. Have one configuration that summarizes the whole API, its behavior and its automation flow.

A example project is available here

Table of contents

I. Installation

You need a recent machine with go installed.

This package has not been tested under the version 1.10.

1. Download and install the package

go get -u git.xdrm.io/go/aicra/cmd/aicra

The library should now be available locally as git.xdrm.io/go/aicra your imports. Moreover, the project compiler have been installed as the aicra command.

The executable aicra will be placed into your $GOPATH/bin folder, if added to your environment PATH it should be available as a standalone command in your terminal. If not, you can simply run $GOPATH/bin/aicra to use the command or create a symbolic link into /usr/local/bin for instance.

II. Setup a project

The default project structure is :

├── main.go          # entry point
|
├── aicra.json       # server configuration file
├── api.json         # API configuration file
|
├── middleware       # middleware implementations
├── controller       # controller implementations
└── type             # custom type checkers

1. Compilation configuration

The aicra.json configuration file defines where are located your controllers, type checkers, and middle-wares ; also it contains what driver you want to use, you have 2 choices :

  1. plugin - for Go implementations (c.f. go plugin system)
  2. generic - for any language implementation (uses standard input and output)

The file uses the json format, each field is described in the table above.

field description example value
root The project folder path ./some-path or /some/path
driver The driver to use for loading controllers, middlewares and type checkers plugin or generic
types.default Whether to load default types into the project true or false
types.folder The folder (relative to the project root) where type checkers' implementations are located ./type or type
controllers.folder The folder (relative to the project root) where controllers' implementations are located ./controller or controller
middlewares.folder The folder (relative to the project root) where middlewares' implementations are located ./middleware or middleware

A sample file can be found here.

Example

In this example we have the controllers inside the controller folder, the middle-wares in the middleware folder and custom type checkers inside the checker folder, we want to load the built-in type checkers and are using the plugin driver. Also our project root is the relative current path . ; note that it is better using an absolute path as your project root.

{
	"root": ".",
	"driver": "plugin",
	"types": {
		"default": true,
		"folder": "type"
	},
	"controllers": {
		"folder": "controller.plugin"
	},
	"middlewares": {
		"folder": "middleware.plugin"
	}
}

2. API Configuration

The whole project behavior is described inside the api.json file. For a better understanding of the format, take a look at this working template. This file defines :

  • resource routes and their methods
  • every input for each method (called argument)
  • every output for each method
  • scope permissions (list of permissions needed for clients to use which method)
  • input policy :
    • type of argument (i.e. for type checkers)
    • required/optional
    • default value
    • variable renaming
Definition

At the root of the json file are available 5 field names :

  1. GET - to define what to do when receiving a request with a GET HTTP method at the root URI
  2. POST - to define what to do when receiving a request with a POST HTTP method at the root URI
  3. PUT - to define what to do when receiving a request with a PUT HTTP method at the root URI
  4. DELETE - to define what to do when receiving a request with a DELETE HTTP method at the root URI
  5. / - to define children URIs ; each will have the same available fields

For each method you will have to create fields described in the table above.

field path description example
info A short human-readable description of what the method does create a new user
scope A 2-dimensional array of permissions. The first dimension can be translated to a or operator, the second dimension as a and. It allows you to combine permissions in complex ways. [["A", "B"], ["C", "D"]] can be translated to : this method needs users to have permissions (A and B) or (C and D)
in The list of arguments that the clients will have to provide. See here for details.
out The list of output data that will be returned by your controllers. It has the same syntax as the in field but is only use for readability purpose and documentation.
Input Arguments
1. Input types

Input arguments defines what data from the HTTP request the method needs. Aicra is able to extract 3 types of data :

  • URI - Slash-separated strings right after the resource URI. For instance, if your controller is bound to the /user URI, you can use the URI slot right after to send the user ID ; Now a client can send requests to the URI /user/:id where :id is a number sent by the client. This kind of input cannot be extracted by name, but rather by index in the URL (begins at 0).
  • Query - data formatted at the end of the URL following the standard HTTP Query syntax.
  • URL encoded - data send inside the body of the request but following the HTTP Query syntax.
  • Multipart - data send inside the body of the request with a dedicated format. This format is not very lightweight but allows you to receive data as well as files.
  • JSON - data send inside the body as a json object ; each key being a variable name, each value its content. Note that the HTTP header 'Content-Type' must be set to application/json for the API to use it.
2. Global Format

The in field in each method contains as list of arguments where the key is the argument name, and the value defines how to manage the variable.

Variable names must be prefixed when requesting URI or Query input types.

  • The first URI data has to be named URL#0, the second one URL#1 and so on...
  • The variable named somevar in the Query has to be named GET@somvar in the configuration.

Example

In this example we want 3 arguments :

  • the 1^st^ one is send at the end of the URI and is a number compliant with the int type checker (else the controller will not be run). It is renamed uri-param, this new name will be sent to the controller.
  • the 2^nd^ one is send in the query (e.g. http://host/uri?get-var=value). It must be a valid int or not given at all (the ? at the beginning of the type tells that the argument is optional) ; it will be named get-param.
  • the 3^rd^ can be send with a JSON body, in multipart or URL encoded it makes no difference and only give clients a choice over the technology to use. If not renamed, the variable will be given to the controller with the name multipart-var.
"in": {
    // arg 1
    "URL#0": {
        "info": "some integer in the URI",
        "type": "int",
        "name": "uri-param"
    },
    // arg 2
    "GET@get-var": {
        "info": "some Query OPTIONAL variable",
        "type": "?int",
        "name": "get-param"
    },
    "multipart-var": { /* ... */ }
}
Example

In this example you can see a pretty basic user/article REST API definition. The API let's you fetch, create, edit, and delete users and do the same for their articles. Users actions will be available at the uri /user, and /article for articles.

3. Controllers

Controllers implement Get, Post, Put, and Delete methods, and have access to special variables surrounded by underscores :

  • _HTTP_METHOD_ the request's HTTP method in uppercase
  • _SCOPE_ the scope filled by middlewares
  • _AUTHORIZATION_ the request's Authorization header

Also special variables found in the return data are processed with special actions :

  • _REDIRECT_ will redirect to the URL contained in the variable
Plugin driver

For each route, you'll have to place your implementation into the controller folder (according to the aicra.json configuration) following the naming convention : add /main.go at the end of the route.

Example - /path/to/some/uri will be inside controller/path/to/some/uri/main.go

Exception - / will be inside controller/ROOT/main.go

A sample directory structure is available here.

Each controller must implement the git.xdrm.io/go/aicra/driver.Controller interface. In addition you must declare the function func Export() Controller to allow dynamic loading of your controller.

Generic driver

This is the same as with the plugin driver but instead of without /main.go at the end.

Example - /path/to/some/uri will be inside controller/path/to/some/uri where the uri file is an executable.

Exception - / will be inside controller/ROOT.

A sample directory structure is available here.

4. Middlewares

In order for your project to manage authentication, the best solution is to create middlewares, there are programs that updates a Scope (i.e. a list of strings) according to internal or persistent (i.e. database) information and the actual http request. They are all run before each request is forwarded to your controller. The scope are used to match the scope field in the configuration file and automatically block non-authenticated requests. Scopes can also be used for implementation-specific behavior such as CSRF management. Controllers have access to the scope through the variable _SCOPE_.

Plugin driver

Each middleware must be directly inside the middleware folder (according to the aicra.json configuration).

Example - the 1-authentication middleware will be inside middleware/1-authentication/main.go.

Note - middleware execution will be ordered by name. Prefixing your middlewares with their order is a good practice.

A sample directory structure is available here.

Each middleware must implement the git.xdrm.io/go/aicra/driver.Middleware interface. In addition you must declare the function func Export() Middleware to allow dynamic loading of your middleware.

Generic driver

This is the same as with the plugin driver but instead of without /main.go at the end.

Example - the 1-authentication middleware will be inside middleware/1-authentication where 1-authentication is an executable

A sample directory structure is available here.

5. Type checkers

In your configuration you will have to use built-in types (e.g. int, any, varchar), but if you want project-specific ones, you can add your own types inside the type folder. You can check what structure to follow by looking at the built-in types. Also it is not required that you use built-in types, you can ignore them by setting types.default = false in the aicra.json configuration.

Each type must be directly inside the type folder. The package name is arbitrary and does not have to match the name (but it is better if it is explicit), because the Match() method already matches the name.

Plugin driver

Each type checker must be directly inside the type folder (according to the aicra.json configuration).

Example - the number type checker will be inside type/number/main.go.

A sample directory structure is available here.

Generic driver

This is the same as with the plugin driver but instead of without /main.go at the end.

Example - the number type checker will be inside type/number where number is an executable

A sample directory structure is available here.

III. Build your project

After each controller, middleware or type implementation, you'll have to compile the project. This can be achieved through the command-line builder.

Usage is aicra /path/to/your/project.

Usually you just have to run the following command inside your project directory :

aicra .

The output should look like

that.

IV. Main

The main default program is pretty small as below :

package main

import (
	"git.xdrm.io/go/aicra"
	"net/http"
)

func main() {

    // 1. create the API from the configuration file
	server, err := aicra.New("api.json")
	if err != nil {
		panic(err)
	}

    // 2. listen to incoming http requests
	err = http.ListenAndServe("127.0.0.1:4242", server)
	if err != nil {
		panic(err)
	}

}

V. Change Log

  • human-readable json configuration
  • nested routes (i.e. /user/:id: and /user/post/:id:)
  • nested URL arguments (i.e. /user/:id: and /user/:id:/post/:id:)
  • useful http methods: GET, POST, PUT, DELETE
  • manage URL, query and body arguments:
    • multipart/form-data (variables and file uploads)
    • application/x-www-form-urlencoded
    • application/json
  • required vs. optional parameters with a default value
  • parameter renaming
  • generic authentication system (i.e. you can override the built-in one)
  • generic type check (i.e. implement custom types alongside built-in ones)
  • built-in types
    • any - wildcard matching all values
    • int - any number (e.g. float, int, uint)
    • string - any text
    • varchar(min, max) - any string with a length between min and max
    • <a> - array containing only elements matching a type
    • <a:b> - map containing only keys of type a and values of type b (a or b can be ommited)
  • generic controllers implementation (shared objects)
  • response interface
  • devmode watcher : watch manifest, watch plugins to compile + hot reload them
  • driver for Go plugins
    • controllers
    • middlewares
    • type checkers
  • driver working with any executable through standard input and output
    • controllers
    • middlewares
    • type checkers
  • project configuration file to select driver, source folders and whether to load default type checkers.
    • used to compile the project by the aicra command
    • used to create an API from aicra.New()