sclevine / yj Goto Github PK

==> Downloading https://github.com/sclevine/yj/releases/download/v5.1.0/yj-macos
curl: (22) The requested URL returned error: 404

Error: yj: Failed to download resource "yj"
Download failed: https://github.com/sclevine/yj/releases/download/v5.1.0/yj-macos

Release files for OS X appear to have an architecture suffix now? (-amd64 versus -arm64)

(perhaps in preparation to support arm64v9 aka M1 targets for OS X? In which case I ❤️ these contributors!!)

Hi. I love this tool! Thank you very much for putting it together!!

I use Docker for many (most?) of my work and it's very handy for me to be able to use containerized builds of tools that I frequently use. Seeing as how yj didn't have a Dockerfile to build an image, I put one together and submitted it as a PR (#7).

If you're open to it, it would be super-swell if the image could be made available on dockerhub. Assuming the PR is accepted, dockerhub could be set to automatically build the image when a commit to the yj repo on github is pushed.

Also, if you want, I can document the build / run process in the README.md file.

Thanks again!!

go get github.com/sclevine/yj

go: downloading github.com/sclevine/yj v0.0.0-20200815061347-554173e71934
go: downloading github.com/hashicorp/hcl v1.0.0
go: downloading github.com/pelletier/go-toml v1.8.0
go: downloading gopkg.in/yaml.v3 v3.0.0-20200615113413-eeeca48fe776
# github.com/sclevine/yj/toml
../go/pkg/mod/github.com/sclevine/[email protected]/toml/encoder.go:63:7: tree.SetPositionPath undefined (type *toml.Tree has no field or method SetPositionPath)
../go/pkg/mod/github.com/sclevine/[email protected]/toml/encoder.go:79:6: tree.SetPositionPath undefined (type *toml.Tree has no field or method SetPositionPath)

[go version go1.16.3 linux/amd64]

I downloaded the compiled Version of YJ.EXE for Windows and run it on my system. VJ starts but nothing happends, only black screen on my command screen. I allowed the exe for run and start something on my system.

Can you add support for HCL v2?

I have a toml file:

["\"foo\""]
"\"bar\"" = "\"baz\""

yj -tj <a.toml failed with:

Error parsing TOML: (1, 2): invalid table array key: invalid bare key character: \

According to the TOML specification:

• The escape \" is valid in basic strings. (https://toml.io/en/v0.5.0#string)
• Quoted keys follow the exact same rules as either basic strings or literal strings. (https://toml.io/en/v0.5.0#keys)
• Naming rules for tables are the same as for keys. (https://toml.io/en/v0.5.0#table)

When its converting yaml which have null as value to HCL replacing the value as empty string which is failing in terraform validation

klusterle:
  host: null
prometheusInteg:
  enabled: true

HCL:

"klusterle" = {
  "host" =
}

"prometheusInteg" = {
  "enabled" = true

#40 fixes an vulnerability classified as HIGH by trivy found in the go yaml library

I have added the yj package in the Arch Linux User Repository (AUR). The package builds fine but the resulting binary will report v0.0.0 as it's version. Any way to fix this?

You can review the PKGBUILD here https://aur.archlinux.org/cgit/aur.git/tree/PKGBUILD?h=yj

I am using the latest release to convert json to toml.

./yj -jj redis.json

But I am getting the error as follows
Error: invalid flags specified: d s . s o

Please provide an example to convert from json file to toml file

This tool would be really cool if could be used from within terraform. Since it's written in Go, creating a terraform provider might be a possibility.

I see that one of the supported formats is HCL version 1. It would be nice if HCL 2 were supported, too. Thanks.

This tool is very promising. It would be great if it supported ini format as well. Thanks.

https://github.com/go-ini/ini

% go get github.com/sclevine/[email protected]
go get: github.com/sclevine/[email protected]: invalid version: module contains a go.mod file, so major version must be compatible: should be v0 or v1, not v5

Hi! I'm running into an issue where converting from YAML to HCL is kind of destructive, with json the issue doesn't show up.

yaml='
route:
  receiver: webhook
  group_by:
    - alertname
    - datacenter
    - app
receivers:
  - name: webhook
    webhook_configs:
      - url: http://localhost:500
      - url: http://localhost:500'

echo -e '-----\nYAML\n-----'
echo "${yaml}"
echo -e '-----\nYAML to YAML\n-----'
echo "${yaml}" | yj yy
echo -e '-----\nYAML to JSON\n-----'
echo "${yaml}" | yj yj
echo -e '-----\nYAML to HCL\n-----'
echo "${yaml}" | yj yc
echo -e '-----\nYAML to HCL to YAML\n-----'
echo "${yaml}" | yj yc | yj yy
echo -e '-----\nYAML to HCL to YAML to HCL\n-----'
echo "${yaml}" | yj yc | yj yy | yj yc

echo -e '-----\nYAML o HCL to YAML vs YAML\n-----'
diff <(echo "${yaml}" | yj yc | yj yy) <(echo "${yaml}" | yj yy)

Results in this output:

-----
YAML
-----
route:
  receiver: webhook
  group_by:
    - alertname
    - datacenter
    - app
receivers:
  - name: webhook
    webhook_configs:
      - url: http://localhost:500
      - url: http://localhost:500
-----
YAML to YAML
-----
route:
  receiver: webhook
  group_by:
    - alertname
    - datacenter
    - app
receivers:
  - name: webhook
    webhook_configs:
      - url: http://localhost:500
      - url: http://localhost:500
-----
YAML to JSON
-----
{"route":{"receiver":"webhook","group_by":["alertname","datacenter","app"]},"receivers":[{"name":"webhook","webhook_configs":[{"url":"http://localhost:500"},{"url":"http://localhost:500"}]}]}
-----
YAML to HCL
-----
"route" = {
  "receiver" = "webhook"

  "group_by" = ["alertname", "datacenter", "app"]
}

"receivers" = {
  "name" = "webhook"

  "webhook_configs" = {
    "url" = "http://localhost:500"
  }

  "webhook_configs" = {
    "url" = "http://localhost:500"
  }
}-----
YAML to HCL to YAML
-----
route
-----
YAML to HCL to YAML to HCL
-----
Error writing HCL: Expected object, got unknown token: 1:1 STRING "route"
-----
YAML o HCL to YAML vs YAML
-----
1c1,11
< route
---
> route:
>   receiver: webhook
>   group_by:
>     - alertname
>     - datacenter
>     - app
> receivers:
>   - name: webhook
>     webhook_configs:
>       - url: http://localhost:500
>       - url: http://localhost:500

I really enjoy yj, and I wonder whether the tool wants to add more funny formats such as Extensible Data Notation.

There is a go project for that https://github.com/go-edn/edn

This is a very small feature request:
It would be useful for our installation mechanism if yj could print its version, say, using yj --version or yj version. Ideally the output is very simple, like v4.0.0.

Thanks for considering this.

The provided binary does not work on arm unfortunately. Could you add an Arm version to the releases?

JSON to TOML changes an integer to a float, this is not expected.

Example:

$ echo '{"foo.bar":"baz","qux":1}' | yj -jt
"foo.bar" = "baz"
qux = 1.0

We'd like to use this in a concourse pipeline with a Docker image that doesn't have golang installed. Unfortunately, this is really hard to do, because the only official release binary is for OS X!

Great tool, good job, and many thanks!

Being able to brew install yj would be a nice-to-have. Open to this?

Hi

Have one query regarding conversion of HCL to/from JSON . Conversion from HCL to JSON seems fine however while converting back the generated json to HCL it is not same . As seen in the example below docker_ports was single element of type list / array when converted to json whereas when it is converted back to HCL from from json , docker_ports is represented as two elements instead of two .Any idea why it was not exactly same as orignal HCL after conversion? Any way to get back same HCL format ?

Original tfvars file

image_id = "ami-123"

cluster_min_nodes = 2

cluster_decimal_nodes = 2.2

cluster_max_nodes = true

availability_zone_names = [
  "us-east-1a",
  "us-west-1c",
]

docker_ports = [{
  internal = 8300
  external = 8300
  protocol = "tcp"
},
{
  internal = 8301
  external = 8301
  protocol = "tcp"
}
] 

Conversion of HCL to json

$ ./yj-linux-amd64 -cj < testing.tfvars

{
  "image_id": "ami-123",
  "cluster_min_nodes": 2,
  "cluster_decimal_nodes": 2.2,
  "cluster_max_nodes": true,
  "availability_zone_names": [
    "us-east-1a",
    "us-west-1c"
  ],
  "docker_ports": [
    {
      "internal": 8300,
      "external": 8300,
      "protocol": "tcp"
    },
    {
      "internal": 8301,
      "external": 8301,
      "protocol": "tcp"
    }
  ]
}

JSON to HCL conversion

/yj-linux-amd64 -jc < testing.tfvars.json
"availability_zone_names" = ["us-east-1a", "us-west-1c"]

"cluster_min_nodes" = 2

"docker_ports" = {
  "external" = 8300

  "internal" = 8300

  "protocol" = "tcp"
}

"docker_ports" = {
  "external" = 8301

  "internal" = 8301

  "protocol" = "tcp"
}

"image_id" = "ami-123"

Thanks a lot !

Notes:

YAML:

a: 1
---
b: 2
---
c: 3

JSON:

{"a": 1}
{"b": 2}
{"c": 3}

(Also allowed: {"a": 1}{"b": 2}{"c": 3})

TOML and HCL should error.
Should we provide a flag to select a document by index?

I used yj -ty. The output is right, except it misses the comments. Both toml and yaml begin comment with #, so just copying every symbol after and including # should do the trick.

Hello,
i know this is kinda a big task, but your tool is very valuable. but i try to move to "secure" languages. Would it be possible that you support Dhall also? Integration guide is https://docs.dhall-lang.org/howtos/How-to-integrate-Dhall.html

Dhall is a computationally more secure language and i want to safe my configcode in dhall and output it into json/yaml/hcl...

On i side note i did a PR to binenv, a tool i use: devops-works/binenv#88 to add your tool to this package manager :)

Trying to convert a .yaml file with multiple documents (seperated by ---) will only convert the first document and discard the rest.

It would be nice to get output for all of them, potentially in an array.