You are late, my friends ;)
BR
So I've to use pip2 because I use pip3 to which I aliasing to pip however, do not wonder about this. ;)

root@kali:/opt/Maryam# pip2 install -r requirements
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Requirement already satisfied: requests in /usr/lib/python2.7/dist-packages (from -r requirements (line 1)) (2.22.0)
Requirement already satisfied: lxml in /usr/local/lib/python2.7/dist-packages (from -r requirements (line 2)) (4.5.0)
Requirement already satisfied: bs4 in /usr/local/lib/python2.7/dist-packages (from -r requirements (line 3)) (0.0.1)
Requirement already satisfied: beautifulsoup4 in /usr/local/lib/python2.7/dist-packages (from bs4->-r requirements (line 3)) (4.8.2)
Requirement already satisfied: soupsieve>=1.2 in /usr/local/lib/python2.7/dist-packages (from beautifulsoup4->bs4->-r requirements (line 3)) (1.9.5)
Requirement already satisfied: backports.functools-lru-cache; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from soupsieve>=1.2->beautifulsoup4->bs4->-r requirements (line 3)) (1.6.1)

root@kali:/opt/Maryam# ./maryam
/usr/local/lib/python2.7/dist-packages/bs4/element.py:16: UserWarning: The soupsieve package is not installed. CSS selectors cannot be used.
'The soupsieve package is not installed. CSS selectors cannot be used.'

| \ / _ |/ ) | | |/ _ | | \
| | | | ( ( | | | | || ( ( | | | | | |
|||| _|||| _ |_||| ||||
(____/

           v1.4.0

[7] osint modules
[4] footprint modules

[maryam][default] >
[maryam][default] >

The issue can be seen on the gif below.

Another new cool feature Maryam can have is exploring IoT open ports using shodan API.
I will start working on it at the earliest.

Adding YouGetSignal's Reverse IP Domain Check tool to modules/osint/dns_search.py

I would like to take this and will make appropriate changes in search modules as well

search classes

1. Add gigablast.com
2. Add sogou.com
3. Add activesearchresults.com
4. Add a new method for core/util/google class to extract the titles

Create an issue if you want to add each of them. You can also contribute to this list by demanding a new source on this issue.

I have made a module that searches for handles, phone numbers, links in telegram groups listed online. Here is a gif of the same: https://asciinema.org/a/dw8aekqSrgxOyUWCp1FHKK4rM. Let me know if i can issue PR.

An OSINT feature module, where the user can find all the accounts of a particular username.

This feature will help the user to find users, organizations, repositories related to the company. This module will also find the sensitive leaked data in the repositories and code.
Please Assign this to me.

I ve been trying to use wapps command in Mayram but i got UnicodeDecodeError for python 3.6 so i checked for python3.7 but got KeyError.

[maryam][default] > wapps -d example.com [!] File "/usr/lib/python3.6/encodings/ascii.py", line 26, in decode. [!] UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 1350: ordinal not in range(128).

The traceback isn't very helpful. Tried to browse wapps.py and module.py but no clue.
Just to verify - maryam should be run with wich python?

This module would help to identify dark web services. I would like to work upon this

Massive improvisation can be done if we try switching from search engines to large databases. The following had clicked with me.
While this stays very much far fetched yet since huge data needs to get stored in workspaces, I'm still skeptical about this idea
Please do check:

Threatminer

IntelX

Aleph

RIPE DB

Rapid7

ThreatCrowd

This section highly needs feedback and can be started to be worked on gradually.

We already have an arxiv search module.

My idea is to create 2 more utils for Microsoft Academic and Google Scholar

And create a scholar/academic/scientific (choose any name you want :P) search module that includes all 3 sources (maybe more).

If approved I can start working on it right away

could you show module search/linkedin?

We currently lack util classes for several important social networks like Facebook, Twitter, Instagram, LinkedIn etc. I would like to add new classes for these.

Please see OWASP/www-project-maryam#6 and follow request described therein to switch OWASP maturity badge from "Flagship" to actual "Incubator". Thank you!

@saeeddhqan is this format good enough for you? Or do you want me to store the paste links as well?

┬─[divya at racharch in ~/a/g/OWASP-Maryam]─[G:shodan]
╰──> λ ./maryam -e email_search -q vodafone.com -e pastebin
[*] [PASTEBIN] Searching ...
[*] EMAILS
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]

Result so far -

┬─[divya at racharch in ~/a/g/OWASP-Maryam]─[G:shodan]
╰──> λ ./maryam -e email_search -q yahoo.com -e bing,google,yahoo,yandex,metacrawler,ask,baidu,startpage,yippy,qwant,duckduckgo
[*] EMAILS
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	apn@yahoo com
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]

Using Just Pastebin:

┬─[divya at racharch in ~/a/g/OWASP-Maryam]─[G:shodan]
╰──> λ ./maryam -e email_search -q yahoo.com -e pastebin
[*] EMAILS
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]_hsieh
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]_mosed
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]_
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected]
[*] 	[email protected][
[*] 	[email protected]

Looks like the DNS Brute option concatenates the sub domain names wrong.
It goes wrong on line: https://github.com/saeeddhqan/Maryam/blob/master/modules/osint/dns_search.py#L94
Where the same variable is reused on line: https://github.com/saeeddhqan/Maryam/blob/master/modules/osint/dns_search.py#L144
The result of this bug is that it concatnates the subdomain in front of the url thus creating invalid url's
The following replacement of line 144 would be sufficient to fix this problem:

tmp_name = "https://{0}.{1}".format(i, host.split('://')[1])

Be warned the HTTPS is hardcoded thus in case of HTTP it would not work. (But still in the future HTTP would be obsolute because of enforced certificate errors)

I am thinking to work on the Reddit OSINT module and will soon send a PR linked to it.

Emails enumerated while scanning can be checked from haveibeenpwned.com. Their API can be used for this purpose same.
Reference: https://haveibeenpwned.com/API/v2

My understanding is that Maryam is GPLv3 or any later version, but the project seems to be lacking license notices in the source files. These notices are important as they let users know which version of the license they may use the work under, and ensure that that information stays with the code even if the source files get separated from the project as a whole. You can learn how to use GNU licenses at https://www.gnu.org/licenses/gpl-howto.en.html. Thanks.

When I first run a module and after gathering the results when I then try to exit from interface by using Ctrl + C. Then instead of showing
[!] Use exit command to exit (or press enter to continue)
it shows
Stopping <module name> module(press enter to continue)...
although the module has completed the execution.

It would be very useful if the tool could search for Common Vulnerabilities and Exposures based on id or name.

Ideally in the future we could automatically detect the CVEs of a given website.

We currently have search modules for most social networks, with a few popular exceptions (Twitch, Pinterest, TikTok, etc). I would like to add new modules for these.

In addition to the CVE module by @z3y50n mentioned in #63 . We can have the following analyzer for available ioc's for existing malwares.
Link to ThreatFox
I will add this once v2.0 comes out!
(And no it does not need API key for basic searchlist)

┬─[divya at racharch in ~/a/c/crypto]
╰──> λ curl -X POST https://threatfox-api.abuse.ch/api/v1/ -d '{ "query": "malwareinfo", "malware": "FluBot", "limit": 10 }'
{
    "query_status": "ok",
    "data": [
        {
            "id": "3033",
            "ioc": "70eea8fb0b93988c1c46460922d74ca4ab2eb0f7f51be307c12932ac510cdd27",
            "threat_type": "payload",
            "threat_type_desc": "Indicator that identifies a malware sample (payload)",
            "ioc_type": "sha256_hash",
            "ioc_type_desc": "SHA256 hash of a malware sample (payload)",
            "malware": "apk.flubot",
            "malware_printable": "FluBot",
            "malware_alias": null,
            "malware_malpedia": "https:\/\/malpedia.caad.fkie.fraunhofer.de\/details\/apk.flubot",
            "confidence_level": 100,
            "first_seen": "2021-03-10 09:04:38 UTC",
            "last_seen": null,
            "reference": null,
            "reporter": "0xabc0",
            "tags": null
        },

I am also adding -

exploit db

The following update claims searchencrypt is deleted, although it still exists. Shouldn't it be removed or the README gets rectified?
See Updates section of README

Site: https://owasp.org/www-project-d4n155/
I can make it module, but I need to understand the pattern that I should use

For details: the Internet Archive
Will be wonderful to enumerate early phases of a domain.

Hello, when I ran your program, I got an error (with python 3.8):
./maryam
Traceback (most recent call last):
File "./maryam", line 34, in
from core import base
File "/home/user/git/Maryam/core/base.py", line 33, in
from core import framework
File "/home/user/git/Maryam/core/framework.py", line 318
async = [self.to_unicode_str(x[i]) if x[i] != None else '' for x in tdata]
^
SyntaxError: invalid syntax

so I searched a bit and found : https://docs.python.org/3/whatsnew/3.7.html
Backwards incompatible syntax changes:
async and await are now reserved keywords.

I renamed async to _async and it works now. Thanks for this fantastic program.

PS: It's my first Github issue, so not sure of if I should add more :)

Adding DNSdumpster to modules/osint/dns_search.py

This module can be used to get information about anything and everything.

I have created a new search module for trello. If you approve, i will issue a PR. Here is a gif of the same
https://asciinema.org/a/erbXUaPUTxS9WeYyk99X1a37p

The file has the privileges.

I would like to fix the following issue.

On using email_search module using hunter engine, the following error is noticed:

[maryam][default] > email_search -q github.com -e hunter -k [REDACTED API KEY]
[*] [HUNTER] Searching in hunter...
[!] Hunter is missed!
[*] Emails
[*] Nothing to declare

Also on giving the wrong api key, ideally this section should have run of the module:
/home/path/to/Maryam/core/util/hunter.py

if 'errors' in self._json_pages:
	self.framework.error(f"[HUNTER] api key is incorrect:'self.key'")
	self.acceptable = False
	return

But again the same error is faced:

[maryam][default] > email_search -q github.com -e hunter --key [REDACTED WRONG API KEY]
[*] [HUNTER] Searching in hunter...
[!] Hunter is missed!
[*] Emails
[*] Nothing to declare

I would like to solve this issue. Please do assign this to me.

Adding ipinfo.io as a module to search for data about IP instantly.

I would like to add a feature in the GitHub module that would find the potentially leaked data in the code of the found repositories.

I have made a one stop module to search cloud storage services like:

1. Google Drive
2. Dropbox
3. OneDrive
4. Box
   Here is a gif of the same: https://asciinema.org/a/jFwVQv3ZechLXb5d6m4hJrzbC
   If you say, i can issue the PR.

The examples located in the wiki page are not valid and need the following changes.

• To searching a RegExp to the web pages

  1. set url example.com should be set domain example.com
  2. crawl option is not valid

• Gain pdf files from search engine

  1. set company EXAMPLE should be set query EXAMPLE
  2. set type pdf should be set file pdf
  3. metacrawler option is not valid

• DNS brute force

  1. dnsbrute, wordlist are not valid options
  2. set host example.com should be set domain example.com

Adding spotify as search module could be useful in finding the behaviour of a user, and information about artists, playlists. Could refer this article regarding use of spotify in osint.

If it seems good I would like to work on it.

Curious as to what the inspiration for the name is, as I know it's an Arabic girl's name in use across a lot of the world.

When I use the search/bing module I get this for every query

Also it doesn't work for other modules that use bing engine (search/linkedin as an example in the following image).

I would like to work on fixing that issue.

*I used a print statement to show that no links are coming from bing.
**Even though the engine isn't set to use google it always uses it so that could maybe be a separate issue

I am fixing this at the moment. Cookies aren't resolved too. I am adding github engine into github module as well.

Using linters to format code and remove unused imports, variables.
I would also like to add a config file for static code analyzers such as prospector and flake8

After #32 this error comes up.

Create a search module for business linkedin

Can someone please include a requirements file? It's rather opaque what is needed to property run this. Thanks!

Probable good ideas I havsecuritytrails e for future improvements in dns enumeration:

urlscan : API for searching existing scans by attributes such as domains, IPs, Autonomous System (AS) numbers, hashes, etc.

rapiddns : Can query the domain name of the same IP website (support IPv6). You can also query subdomain information.

hackertarget[PAID] : This has a whole bunch of resources, I still need feedback on this

Security trails
I will start at the earliest once the above gets approved.