The following issues were found in Gopkg.toml:

✗ unable to deduce repository and source type for "golang.org/x/oauth2": unable to read metadata: unable to fetch raw metadata: failed HTTP request to URL "http://golang.org/x/oauth2?go-get=1": Get http://golang.org/x/oauth2?go-get=1: dial tcp 216.239.37.1:80: i/o timeout

when use make , throw out this error.

gOSINT in has been rewritten almost entirely, replacing modules logic and enhancing performances. This unfortunately caused the concatenation of the module (available in 0.5 stable) is now gone. Since it's a great feature I'm planning to reintegrate it for the new 1.0 release.

At the moment the git module is limited to git API or memory space.
This can lead to 2 problems:

• The git website API are too limited and will block the mail fetching + one request per 100 commits is not so good
• Since the plain search is done cloning the entire repo in memory is not a really good thing with big repos

The possible solution was to implement the equivalent for git clone -n but is not currently supported from go-git and i don't want to depend from a wrapper like https://github.com/libgit2/git2go (pure go is always better), less dependencies, less problems

So I'm waiting the implementation of src-d/go-git/pull/721 to proceed with the reworking

The new module should be way faster and less resource hungry

If somebody has time, it would nice to have an https://intelx.io module for your project.
We have a SDK here with some code samples (including Go code): https://github.com/IntelligenceX/SDK

At the moment gOSINT heavily depends on too many packages, would be good to rewrite some of them as standalone functions (when possible)

Here is a visualization graph for the dev branch

After the release of the new PNI module gOSINT acquired its first external dependecy: tesseract-ocr

This breaks the windows build script. A good addition will be to restore the support, here more details
https://github.com/tesseract-ocr/tesseract/wiki

From 1.0 gOSINT will support SemVer

This tool isn't Cyber enough for my liking, and I can't uninstall it.

Please provide uninstall.sh script

Thanks

I would add a module that let run gOSINT as a web service exposing REST API

https://www.criminalip.io/ - Criminal IP is a specialized Cyber Threat Intelligence (CTI) search engine that allows users to search for various security-related information such as malicious IP addresses, domains, banners, etc. It can be widely integrated

Here we will discuss new modules insertion, please always refer to what it's done in https://github.com/Nhoya/gOSINT/projects and see the dev branch. New PR for modules are always welcomed

To get the list of commitsgitAPI.go calls the API manually with an url like https://api.github.com/repos/PyGithub/PyGithub/commits?per_page=5000. The last parameter does not seem to have any effect, only the last 100 commits are actually returned by this page.

It would be better to get all of them, only solution I know is to use the API (which is really slow for large repos)

After the implementation of pagination for GitHub and BitBucket API (thanks to the report on #1) i was thinking about using some workers to speedup the scraping process.

My idea is to spawn a worker every 5 pages.

Any idea, suggestion and contribution is well accepted.

The current solution available at paginator spawns a goroutine for each page

Since HIBP moved an API and subscription-based model the gOSINT module is not working properly. Working on a workaround ASAP

PR are welcomed, we can also use an internal library but since BitBucket is a bigger platform would be nice to use an external library always maintained

Implementing censys module for range search and host details

This is a bug relative to viper the current SafeWriteConfigAs is broken and I hope will be fixed ASAP, since this is relative only to the develop version of gOSINT i'll wait for spf13/viper#450 to be approved

Hello, thank you for the work.

When you try to use a reproducble build process, the package fails.

Steps to reproduce:

1. go mod init go.mod
2. go mod tidy
3. go mod download
4. go build -o gosint -v -ldflags="-s -w" cmd/gosint/main.go

Then wait for:

└──╼ $ make gosint_build
go build -o gosint -v -ldflags="-s -w" cmd/gosint/main.go
package command-line-arguments
	cmd/gosint/main.go:7:2: use of internal package github.com/Nhoya/gOSINT/internal/axfr not allowed
package command-line-arguments
	cmd/gosint/main.go:8:2: use of internal package github.com/Nhoya/gOSINT/internal/git not allowed
package command-line-arguments
	cmd/gosint/main.go:9:2: use of internal package github.com/Nhoya/gOSINT/internal/hibp not allowed
package command-line-arguments
	cmd/gosint/main.go:10:2: use of internal package github.com/Nhoya/gOSINT/internal/pgp not allowed
package command-line-arguments
	cmd/gosint/main.go:11:2: use of internal package github.com/Nhoya/gOSINT/internal/pni not allowed
package command-line-arguments
	cmd/gosint/main.go:12:2: use of internal package github.com/Nhoya/gOSINT/internal/reversewhois not allowed
package command-line-arguments
	cmd/gosint/main.go:13:2: use of internal package github.com/Nhoya/gOSINT/internal/shodan not allowed
package command-line-arguments
	cmd/gosint/main.go:14:2: use of internal package github.com/Nhoya/gOSINT/internal/telegram not allowed
package command-line-arguments
	cmd/gosint/main.go:15:2: use of internal package github.com/Nhoya/gOSINT/internal/utils not allowed
make: *** [Makefile:14: gosint_build] Error 1

The change was introduced in https://golang.org/doc/go1.4#internalpackages, would be good if you change the repo name and update the dependencies pointing to the new directory name.

Thank you.

Regards,
Ed

Pni module is not working

error while trying to get gosint on blackarch

As with many open-source tools, it's encouraged to create Dockerfile, and compose, to run the project in isolated, container environment.

We need to find an efficient way to retrieve info from playstore links (email and name)

Shodan Module is already in the develop version, will be released soon