aicra/README.md

411 lines
18 KiB
Markdown
Raw Normal View History

2018-07-08 17:12:47 +00:00
# | aicra |
2018-05-30 15:01:16 +00:00
2018-07-08 23:13:06 +00:00
[![Go version](https://img.shields.io/badge/go_version-1.10.3-blue.svg)](https://golang.org/doc/go1.10)
2018-07-11 17:06:11 +00:00
[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
2018-07-08 17:12:47 +00:00
[![Go Report Card](https://goreportcard.com/badge/git.xdrm.io/go/aicra)](https://goreportcard.com/report/git.xdrm.io/go/aicra)
2018-07-08 23:13:06 +00:00
[![Go doc](https://godoc.org/git.xdrm.io/go/aicra?status.svg)](https://godoc.org/git.xdrm.io/go/aicra)
2018-05-30 15:01:16 +00:00
2018-07-11 17:06:11 +00:00
2018-10-03 16:37:37 +00:00
**Aicra** is a *configuration-driven* REST **API engine** in *Go* that allows you to create a fully featured API.
2018-10-03 16:37:37 +00:00
The whole API management is done for you from a configuration file describing your API, you just need to implement :
2018-10-01 19:11:11 +00:00
2018-10-03 16:37:37 +00:00
- the <u>controllers</u>
- the <u>middle-wares</u> (_e.g. authentication, csrf_)
- and optionnally the <u>type checkers</u> to check if input values follows some rules
2018-10-01 19:11:11 +00:00
2018-10-03 16:37:37 +00:00
> There is 2 available drivers that will load your implementations. The `plugin` driver is for Go programmers, the `generic` one is for any language (it uses standard input and output).
2018-10-01 19:11:11 +00:00
2018-10-03 16:37:37 +00:00
The engine has been designed with the following concepts in mind.
| concept | explanation |
|---|---|
| meaningful defaults | Defaults and default values work without further understanding |
2018-10-03 16:37:37 +00:00
| configuration driven | Avoid information duplication. Automate anything that can be automated without losing control. Have *one* configuration that summarizes the whole API, its behavior and its automation flow. |
2018-05-30 15:01:16 +00:00
2018-10-03 16:37:37 +00:00
> A example project is available [here](https://git.xdrm.io/example/aicra)
2018-07-08 17:12:47 +00:00
2018-05-30 15:01:16 +00:00
2018-10-03 16:37:37 +00:00
### Table of contents
2018-07-11 17:13:15 +00:00
<!-- toc -->
- [I. Installation](#i-installation)
* [1. Download and install the package](#1-download-and-install-the-package)
- [II. Setup a project](#ii-setup-a-project)
* [1. Configuration](#1-configuration)
* [2. Controllers](#2-controllers)
* [3. Middlewares](#3-middlewares)
* [4. Custom types](#4-custom-types)
- [III. Build your project](#iii-build-your-project)
- [IV. Main](#iv-main)
- [V. Change Log](#v-change-log)
<!-- tocstop -->
2018-07-08 17:12:47 +00:00
2018-10-03 16:37:37 +00:00
### I. Installation
2018-09-13 08:21:35 +00:00
You need a recent machine with `go` [installed](https://golang.org/doc/install).
> This package has not been tested under the version **1.10**.
2018-10-03 16:37:37 +00:00
#### 1. Download and install the package
```bash
2018-10-02 07:58:51 +00:00
go get -u git.xdrm.io/go/aicra/cmd/aicra
```
2018-10-03 16:37:37 +00:00
The library should now be available locally as `git.xdrm.io/go/aicra` your imports. Moreover, the **project compiler** have been installed as the `aicra` command.
2018-07-08 08:44:50 +00:00
2018-10-03 16:37:37 +00:00
> The executable `aicra` will be placed into your `$GOPATH/bin` folder, if added to your environment PATH it should be available as a standalone command in your terminal. If not, you can simply run `$GOPATH/bin/aicra` to use the command or create a symbolic link into `/usr/local/bin` for instance.
2018-10-03 16:37:37 +00:00
### II. Setup a project
2018-10-03 16:37:37 +00:00
The default project structure is :
2018-07-08 08:44:50 +00:00
2018-10-03 16:37:37 +00:00
```bash
├── main.go # entry point
2018-10-01 19:11:11 +00:00
|
2018-10-03 16:37:37 +00:00
├── aicra.json # server configuration file
├── api.json # API configuration file
2018-10-01 19:11:11 +00:00
|
2018-10-03 16:37:37 +00:00
├── middleware # middleware implementations
├── controller # controller implementations
└── type # custom type checkers
2018-10-01 19:11:11 +00:00
```
2018-07-08 17:12:47 +00:00
2018-10-03 16:37:37 +00:00
#### 1. Compilation configuration
2018-07-08 17:12:47 +00:00
2018-10-03 16:37:37 +00:00
The `aicra.json` configuration file defines where are located your controllers, type checkers, and middle-wares ; also it contains what driver you want to use, you have 2 choices :
2018-07-08 08:44:50 +00:00
2018-10-03 16:37:37 +00:00
1. **plugin** - for Go implementations (_c.f. [go plugin system](https://golang.org/pkg/plugin/)_)
2018-10-01 19:11:11 +00:00
2. **generic** - for any language implementation (uses standard input and output)
2018-10-03 16:37:37 +00:00
The file uses the [json](https://json.org/) format, each field is described in the table above.
| field | description | example value |
| ---------------------- | ------------------------------------------------------------ | --------------------------------- |
| `root` | The project folder path | `./some-path` or `/some/path` |
| `driver` | The driver to use for loading controllers, middlewares and type checkers | `plugin` or `generic` |
| `types`.`default` | Whether to load default types into the project | `true` or `false` |
| `types`.`folder` | The folder (relative to the project root) where type checkers' implementations are located | `./type` or `type` |
| `controllers`.`folder` | The folder (relative to the project root) where controllers' implementations are located | `./controller` or `controller` |
| `middlewares`.`folder` | The folder (relative to the project root) where middlewares' implementations are located | `./middleware` or `middleware` |
2018-07-08 08:44:50 +00:00
2018-10-01 19:11:11 +00:00
A sample file can be found [here](https://git.xdrm.io/example/aicra/src/master/aicra.json).
2018-07-08 08:44:50 +00:00
2018-10-03 16:37:37 +00:00
###### Example
In this example we have the controllers inside the `controller` folder, the middle-wares in the `middleware` folder and custom type checkers inside the `checker` folder, we want to load the built-in type checkers and are using the `plugin` driver. Also our project root is the relative current path `.` ; note that it is better using an absolute path as your project root.
```json
{
"root": ".",
"driver": "plugin",
"types": {
"default": true,
"folder": "type"
},
"controllers": {
"folder": "controller.plugin"
},
"middlewares": {
"folder": "middleware.plugin"
}
}
```
#### 2. API Configuration
2018-07-08 08:44:50 +00:00
2018-10-01 19:11:11 +00:00
The whole project behavior is described inside the `api.json` file. For a better understanding of the format, take a look at this working [template](https://git.xdrm.io/example/aicra/src/master/api.json). This file defines :
2018-10-01 19:11:11 +00:00
- resource routes and their methods
2018-07-08 08:44:50 +00:00
- every input for each method (called *argument*)
- every output for each method
2018-10-03 16:37:37 +00:00
- scope permissions (list of permissions needed for clients to use which method)
2018-10-01 19:11:11 +00:00
- input policy :
2018-10-03 16:37:37 +00:00
- type of argument (_i.e. for type checkers_)
2018-10-01 19:11:11 +00:00
- required/optional
- default value
- variable renaming
2018-10-03 16:37:37 +00:00
###### Definition
At the root of the json file are available 5 field names :
1. `GET` - to define what to do when receiving a request with a GET HTTP method at the root URI
2. `POST` - to define what to do when receiving a request with a POST HTTP method at the root URI
3. `PUT` - to define what to do when receiving a request with a PUT HTTP method at the root URI
4. `DELETE` - to define what to do when receiving a request with a DELETE HTTP method at the root URI
5. `/` - to define children URIs ; each will have the same available fields
For each method you will have to create fields described in the table above.
| field path | description | example |
| ---------- | ------------------------------------------------------------ | ------------------------------------------------------------ |
| `info` | A short human-readable description of what the method does | `create a new user` |
| `scope` | A 2-dimensional array of permissions. The first dimension can be translated to a **or** operator, the second dimension as a **and**. It allows you to combine permissions in complex ways. | `[["A", "B"], ["C", "D"]]` can be translated to : this method needs users to have permissions (A **and** B) **or** (C **and** D) |
| `in` | The list of arguments that the clients will have to provide. See [here](#input-arguments) for details. | |
| `out` | The list of output data that will be returned by your controllers. It has the same syntax as the `in` field but is only use for readability purpose and documentation. | |
##### Input Arguments
###### 1. Input types
Input arguments defines what data from the HTTP request the method needs. Aicra is able to extract 3 types of data :
- **URI** - Slash-separated strings right after the resource URI. For instance, if your controller is bound to the `/user` URI, you can use the *URI slot* right after to send the user ID ; Now a client can send requests to the URI `/user/:id` where `:id` is a number sent by the client. This kind of input cannot be extracted by name, but rather by index in the URL (_begins at 0_).
- **Query** - data formatted at the end of the URL following the standard [HTTP Query](https://tools.ietf.org/html/rfc3986#section-3.4) syntax.
- **URL encoded** - data send inside the body of the request but following the [HTTP Query](https://tools.ietf.org/html/rfc3986#section-3.4) syntax.
- **Multipart** - data send inside the body of the request with a dedicated [format](https://tools.ietf.org/html/rfc2388#section-3). This format is not very lightweight but allows you to receive data as well as files.
- **JSON** - data send inside the body as a json object ; each key being a variable name, each value its content. Note that the HTTP header '**Content-Type**' must be set to `application/json` for the API to use it.
###### 2. Global Format
The `in` field in each method contains as list of arguments where the key is the argument name, and the value defines how to manage the variable.
> Variable names must be <u>prefixed</u> when requesting **URI** or **Query** input types.
>
> - The first **URI** data has to be named `URL#0`, the second one `URL#1` and so on...
> - The variable named `somevar` in the **Query** has to be named `GET@somvar` in the configuration.
**Example**
In this example we want 3 arguments :
- the 1^st^ one is send at the end of the URI and is a number compliant with the `int` type checker (else the controller will not be run). It is renamed `uri-param`, this new name will be sent to the controller.
- the 2^nd^ one is send in the query (_e.g. [http://host/uri?get-var=value](http://host/uri?get-var=value)_). It must be a valid `int` or not given at all (the `?` at the beginning of the type tells that the argument is **optional**) ; it will be named `get-param`.
- the 3^rd^ can be send with a **JSON** body, in **multipart** or **URL encoded** it makes no difference and only give clients a choice over the technology to use. If not renamed, the variable will be given to the controller with the name `multipart-var`.
```json
"in": {
// arg 1
"URL#0": {
"info": "some integer in the URI",
"type": "int",
"name": "uri-param"
},
// arg 2
"GET@get-var": {
"info": "some Query OPTIONAL variable",
"type": "?int",
"name": "get-param"
},
"multipart-var": { /* ... */ }
}
```
###### Example
In this example you can see a pretty basic user/article REST API definition. The API let's you fetch, create, edit, and delete users and do the same for their articles. Users actions will be available at the uri `/user`, and `/article` for articles.
2018-10-01 19:11:11 +00:00
2018-10-03 16:37:37 +00:00
#### 3. Controllers
2018-10-01 19:11:11 +00:00
Controllers implement `Get`, `Post`, `Put`, and `Delete` methods, and have access to special variables surrounded by underscores :
- `_HTTP_METHOD_` the request's HTTP method in uppercase
- `_SCOPE_` the scope filled by middlewares
- `_AUTHORIZATION_` the request's **Authorization** header
Also special variables found in the return data are processed with special actions :
- `_REDIRECT_` will redirect to the URL contained in the variable
###### Plugin driver
For each route, you'll have to place your implementation into the `controller` folder (according to the *aicra.json* configuration) following the naming convention : add `/main.go` at the end of the route.
2018-10-01 19:11:11 +00:00
> <u>Example</u> - `/path/to/some/uri` will be inside `controller/path/to/some/uri/main.go`
2018-10-01 19:11:11 +00:00
> <u>Exception</u> - `/` will be inside `controller/ROOT/main.go`
2018-10-01 19:11:11 +00:00
A sample directory structure is available [here](https://git.xdrm.io/example/aicra/src/master/controller.plugin).
2018-07-08 08:44:50 +00:00
2018-10-01 19:11:11 +00:00
Each controller must implement the `git.xdrm.io/go/aicra/driver.Controller` interface. In addition you must declare the function `func Export() Controller` to allow dynamic loading of your controller.
2018-10-01 19:11:11 +00:00
###### Generic driver
2018-10-01 19:11:11 +00:00
This is the same as with the plugin driver but instead of without `/main.go` at the end.
2018-10-01 19:11:11 +00:00
> <u>Example</u> - `/path/to/some/uri` will be inside `controller/path/to/some/uri` where the **uri** file is an executable.
2018-07-08 08:44:50 +00:00
2018-10-01 19:11:11 +00:00
> <u>Exception</u> - `/` will be inside `controller/ROOT`.
2018-07-08 08:44:50 +00:00
2018-10-01 19:11:11 +00:00
A sample directory structure is available [here](https://git.xdrm.io/example/aicra/src/master/controller.generic).
2018-07-08 08:44:50 +00:00
2018-10-01 19:11:11 +00:00
2018-10-03 16:37:37 +00:00
#### 4. Middlewares
2018-10-01 19:11:11 +00:00
In order for your project to manage authentication, the best solution is to create middlewares, there are programs that updates a *Scope* (*i.e. a list of strings*) according to internal or persistent (*i.e.* database) information and the actual http request. They are all run before each request is forwarded to your controller. The scope are used to match the `scope` field in the configuration file and automatically block non-authenticated requests. Scopes can also be used for implementation-specific behavior such as _CSRF_ management. Controllers have access to the scope through the variable `_SCOPE_`.
###### Plugin driver
2018-10-02 07:58:51 +00:00
Each middleware must be **directly** inside the `middleware` folder (according to the _aicra.json_ configuration).
2018-07-08 08:44:50 +00:00
2018-07-08 22:15:29 +00:00
> Example - the `1-authentication` middleware will be inside `middleware/1-authentication/main.go`.
2018-07-08 08:44:50 +00:00
**Note** - middleware execution will be ordered by name. Prefixing your middlewares with their order is a good practice.
2018-10-01 19:11:11 +00:00
A sample directory structure is available [here](https://git.xdrm.io/example/aicra/src/master/middleware.plugin).
2018-07-08 08:44:50 +00:00
2018-10-01 19:11:11 +00:00
Each middleware must implement the `git.xdrm.io/go/aicra/driver.Middleware` interface. In addition you must declare the function `func Export() Middleware` to allow dynamic loading of your middleware.
2018-07-08 08:44:50 +00:00
2018-10-01 19:11:11 +00:00
###### Generic driver
2018-10-01 19:11:11 +00:00
This is the same as with the plugin driver but instead of without `/main.go` at the end.
2018-10-01 19:11:11 +00:00
> Example - the `1-authentication` middleware will be inside `middleware/1-authentication` where **1-authentication** is an executable
2018-10-01 19:11:11 +00:00
A sample directory structure is available [here](https://git.xdrm.io/example/aicra/src/master/middleware.generic).
2018-10-03 16:37:37 +00:00
#### 5. Type checkers
2018-10-01 19:11:11 +00:00
In your configuration you will have to use built-in types (*e.g.* int, any, varchar), but if you want project-specific ones, you can add your own types inside the `type` folder. You can check what structure to follow by looking at the [built-in types](https://git.xdrm.io/go/aicra/src/master/internal/checker/default). Also it is not required that you use built-in types, you can ignore them by setting `types.default = false` in the _aicra.json_ configuration.
2018-07-08 08:44:50 +00:00
2018-10-01 19:11:11 +00:00
Each type must be **directly** inside the `type` folder. The package name is arbitrary and does not have to match the name (but it is better if it is explicit), because the `Match()` method already matches the name.
###### Plugin driver
2018-10-02 07:58:51 +00:00
Each type checker must be **directly** inside the `type` folder (according to the _aicra.json_ configuration).
2018-10-01 19:11:11 +00:00
> Example - the `number` type checker will be inside `type/number/main.go`.
A sample directory structure is available [here](https://git.xdrm.io/example/aicra/src/master/type.plugin).
###### Generic driver
This is the same as with the plugin driver but instead of without `/main.go` at the end.
> Example - the `number` type checker will be inside `type/number` where **number** is an executable
A sample directory structure is available [here](https://git.xdrm.io/example/aicra/src/master/type.generic).
2018-10-03 16:37:37 +00:00
### III. Build your project
2018-10-01 19:11:11 +00:00
After each controller, middleware or type implementation, you'll have to compile the project. This can be achieved through the command-line builder.
2018-10-01 19:11:11 +00:00
Usage is `aicra /path/to/your/project`.
2018-07-08 08:44:50 +00:00
2018-10-01 19:11:11 +00:00
Usually you just have to run the following command inside your project directory :
2018-07-08 08:44:50 +00:00
```bash
aicra .
2018-07-08 08:44:50 +00:00
```
2018-07-08 08:47:29 +00:00
The output should look like
![that](./README.assets/1531039386654.png).
2018-07-08 17:12:47 +00:00
#### IV. Main
2018-07-07 16:17:52 +00:00
2018-07-08 17:12:47 +00:00
The main default program is pretty small as below :
2018-07-07 16:17:52 +00:00
```go
package main
import (
"git.xdrm.io/go/aicra"
"net/http"
)
2018-07-07 16:17:52 +00:00
func main() {
2018-07-11 17:13:15 +00:00
2018-10-01 19:11:11 +00:00
// 1. create the API from the configuration file
server, err := aicra.New("api.json")
if err != nil {
panic(err)
}
2018-07-11 17:13:15 +00:00
// 2. listen to incoming http requests
err = http.ListenAndServe("127.0.0.1:4242", server)
if err != nil {
panic(err)
}
2018-07-08 22:15:29 +00:00
2018-07-07 16:17:52 +00:00
}
```
2018-07-08 17:12:47 +00:00
#### V. Change Log
- [x] human-readable json configuration
2018-07-08 08:44:50 +00:00
- [x] nested routes (*i.e. `/user/:id:` and `/user/post/:id:`*)
- [ ] nested URL arguments (*i.e. `/user/:id:` and `/user/:id:/post/:id:`*)
- [x] useful http methods: GET, POST, PUT, DELETE
- [x] manage URL, query and body arguments:
- [x] multipart/form-data (variables and file uploads)
- [x] application/x-www-form-urlencoded
- [x] application/json
- [x] required vs. optional parameters with a default value
- [x] parameter renaming
- [ ] generic authentication system (*i.e. you can override the built-in one*)
- [x] generic type check (*i.e. implement custom types alongside built-in ones*)
- [ ] built-in types
2018-07-08 17:12:47 +00:00
- [x] `any` - wildcard matching all values
- [x] `int` - any number (*e.g. float, int, uint*)
- [x] `string` - any text
- [x] `varchar(min, max)` - any string with a length between `min` and `max`
- [ ] `<a>` - array containing **only** elements matching `a` type
- [ ] `<a:b>` - map containing **only** keys of type `a` and values of type `b` (*a or b can be ommited*)
2018-06-01 09:08:31 +00:00
- [x] generic controllers implementation (shared objects)
2018-07-08 17:12:47 +00:00
- [x] response interface
2018-07-11 17:13:15 +00:00
- [ ] devmode watcher : watch manifest, watch plugins to compile + hot reload them
2018-10-01 19:11:11 +00:00
- [x] driver for Go plugins
- [x] controllers
- [x] middlewares
- [x] type checkers
- [x] driver working with any executable through standard input and output
- [x] controllers
- [x] middlewares
- [x] type checkers
- [x] project configuration file to select **driver**, source folders and whether to load default type checkers.
- [x] used to compile the project by the `aicra` command
2018-10-02 07:58:51 +00:00
- [x] used to create an API from `aicra.New()`