Code Monkey home page Code Monkey logo

logs-js's Introduction

No longer maintained

This software is no longer being maintainted and should not be chosen for new projects. See this issue for more information

Apex Serverless Architecture

Apex lets you build, deploy, and manage AWS Lambda functions with ease. With Apex you can use languages that are not natively supported by AWS Lambda through the use of a Node.js shim injected into the build. A variety of workflow related tooling is provided for testing functions, rolling back deploys, viewing metrics, tailing logs, hooking into the build system and more.

This project is designed for event-driven pipelines as it does not abstract away FaaS (functions as a service). If you are building web applications, APIs, or sites, consider using Apex Up, which provides a more out-of-the-box experience for these use-cases.

Installation

On macOS, Linux, or OpenBSD run the following:

curl https://raw.githubusercontent.com/apex/apex/master/install.sh | sh

Note that you may need to run the sudo version below, or alternatively chown /usr/local:

curl https://raw.githubusercontent.com/apex/apex/master/install.sh | sudo sh

On Windows download binary.

After downloading, rename binary file 'apex.exe', then add to PATH.

If already installed, upgrade with:

apex upgrade

Runtimes

Currently supports:

  • Node.js
  • Golang
  • Python
  • Ruby
  • Java
  • Rust
  • Clojure

Example projects for all supported runtimes can be found in _examples directory.

Features

  • Supports languages Lambda does not natively support via shim
  • Binary install (install apex quickly for continuous deployment in CI etc)
  • Hook support for running commands (transpile code, lint, dependency management, etc)
  • Batteries included but optional (opt-in to higher level abstractions)
  • Environment variable population via command-line, file, or inline config
  • Idempotent deployments (checksums skip already-deployed code)
  • Multiple environments via project.ENV.json and function.ENV.json files
  • Configuration inheritance and overrides
  • Command-line function invocation with JSON streams
  • Command & function name autocompletion
  • Function name globbing (ex: apex deploy api_*)
  • Transparently generates a zip for your deploy
  • Project bootstrapping with optional Terraform support
  • Function metrics and cost analysis
  • Ignore deploying files with .apexignore
  • Function rollback support
  • Tail function logs
  • Concurrency for quick deploys
  • Dry-run to preview changes
  • VPC support
  • Multiple region support
  • Lambda@Edge support

Sponsors

Does your company use Apex? Help keep the project bug-free and feature rich by sponsoring the project.

Backers

Love our work and community? Become a backer.

Example

Apex projects are made up of a project.json configuration file, and zero or more Lambda functions defined in the "functions" directory. Here's an example file structure:

project.json
functions
├── bar
│   ├── function.json
│   └── index.js
└── foo
    ├── function.json
    └── index.js

The project.json file defines project level configuration that applies to all functions, and defines dependencies. For this simple example the following will do:

{
  "name": "example",
  "description": "Example project"
}

Each function uses a function.json configuration file to define function-specific properties such as the runtime, amount of memory allocated, and timeout. This file is completely optional, as you can specify defaults in your project.json file. For example:

{
  "name": "bar",
  "description": "Node.js example function",
  "runtime": "nodejs4.3",
  "memory": 128,
  "timeout": 5,
  "role": "arn:aws:iam::293503197324:role/lambda"
}

Now the directory structure for your project would be:

project.json
functions
├── bar
│   └── index.js
└── foo
    └── index.js

Finally the source for the functions themselves look like this in Node.js:

console.log('start bar')
exports.handle = function(e, ctx) {
  ctx.succeed({ hello: e.name })
}

Apex operates at the project level, but many commands allow you to specify specific functions. For example you may deploy the entire project with a single command:

$ apex deploy

Or whitelist functions to deploy:

$ apex deploy foo bar

Invoke it!

$ echo '{ "name": "Tobi" }' | apex invoke bar
{ "hello": "Tobi" }

See the Documentation for more information.

Links


Build Status Slack Status GoDoc OpenCollective OpenCollective

logs-js's People

Contributors

tj avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

Forkers

seanpm2001

logs-js's Issues

Should we migrate away?

We love apex and want to stick with it but have been running up against issues. I've outlined them below, please let me know if you think Apex is the right solution for us at the moment or if it makes sense for us to migrate away from it.

Background
Our product is a browser extension that executes on web pages we don't control. Consequently, we log relatively large payloads to get a better idea of what was happening in the browser when the log was issued.

Problems we've faced
We initially saw exceptions thrown when our message strings exceeded the limit in structured data mode (#4 - thanks for your help with that). We created a new project in plain-text mode, and now the apex web interfaces freezes often. We often have to refresh the page to several times before a query produces data. We were also billed for $488 in charges last month for "BigQuery Analysis" (see screenshot below). This doesn't seem expected.

Conclusion
Given our use case, is it possible to run apex at low cost and with good performance?

Thanks in advance!

======================================================

BigQuery Analysis

Adding option "snapshot" to an event

Heya 👋,

Working with the JS client on both the server and client and loving it so far.

Would it be possible to add some sort of "snapshot" field to to the event type which isn't indexed/searchable?

Essentially it would be nice to catch a snapshot of an HTTP request when it fails, or the response from a USB device etc... currently I am adding this data to the fields key and it does work, however it really muddies the fields column on the right hand side.

Cannot copy id to clipboard

When I click on id and choose "Copy to clipboard" I get "undefined" copied instead of id value.

It does work for all the other fields. For id it shows "Copied to clipboard" toast but doesn't copy the value.

400 when using client

Hi, I can manually curl my api endpoint...

http POST https://logs-xxxxxx-xx.a.run.app/add_events authorization:"Bearer xxxxx" events:='[{"message":"ioooooo","fields":{"lollai":"assai"},"level":"info"}]' project_id="test"

...but I can't get the client to work:

const { Client } = require('apex-logs')

const client = new Client({
  url: 'https://logs-xxxxx-xxxx.a.run.app/',
  authToken: '----'
})

async function run() {
  while (true) {
    await client.addEvents([{message: "hello"}], 'test')
    await new Promise((resolve, reject) => setTimeout(resolve, 1000))
  }
}

run().catch((err) => {
  console.error(err)
  throw err
})
internal/process/promises.js:213
        triggerUncaughtException(err, true /* fromPromise */);
        ^

ClientError: Failed to parse malformed JSON body
    at /.../logs/node_modules/apex-logs/dist/client.js:49:23
    at Generator.next (<anonymous>)
    at fulfilled (/.../logs/node_modules/apex-logs/dist/client.js:5:58)
    at processTicksAndRejections (internal/process/task_queues.js:93:5) {
  status: 400,
  type: 'bad_request'

Insertions fail when key too long

Hey there, seeing this error quite frequently:

Clustering encountered a key Msg_0_CLOUD_QUERY_TABLE.message that is 2115 
bytes long, which is more than the maximum allowed length of 1024 bytes.

I have an example request that's failing, but it's long and contains some potentially sensitive information that I don't trust myself to remove so I can send it privately.

Thanks!

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.