Get all href urls from an HTML string
Install get-hrefs using npm:
npm install --save get-hrefsconst getHrefs = require('get-hrefs');
getHrefs(`
<body>
<a href="http://example.com">Example</a>
</body>
`);
// ["http://example.com"]
getHrefs(`
<head>
<base href="http://example.com/path1/">
</head>
<body>
<a href="path2/index.html">Example</a>
</body>
`);
// ["http://example.com/path1/path2/index.html"]$> get-hrefs --help
Get all href urls from an HTML string
Usage:
get-hrefs <html file>
cat <html file> | get-hrefs
Options:
-b, --base-url Set baseUrl
<all other flags are passed to normalize-url>
Examples:
curl -s example.com | get-hrefs
echo '<a href="http://www.example.com">Link</a>' | get-hrefs --strip-w-w-wRun npm run build:bq and upload dist/get-hrefs.js to GCP Cloud Storage Bucket.
CREATE TEMP FUNCTION
getHrefs(html STRING,
baseUrl STRING)
RETURNS ARRAY<STRING>
LANGUAGE js OPTIONS ( library=["gs://<YOUR_BUCKET>/get-hrefs.js"] ) AS """
return getHrefs(html, {baseUrl})
""";
SELECT
getHrefs('''<body>
<a href="lotto.html">Example</a>
</body>''', 'https://www.veikkaus.fi')
| Name | Type | Description |
|---|---|---|
| html | String |
The HTML string to extract hrefs from |
| options | Object |
Optional options |
Returns: Array<String>, all unique and normalized hrefs resolved from any provided baseUrl and <base href="..."> in the HTML document.
Type: String
Default: ""
The baseUrl to use for relative hrefs. The module also takes <base ...> tags into account.
Type: Object
Default: {"http": true, "https": true}
Specifies which protocols to allow by setting their respective key (the protocol name without ":") in allowedProtocols to true (or to false to disable one of the defaults), e.g. allowedProtocols: {tel: true, http: false} will return only found URLs with the protocols tel: or https:.
All other options are passed to normalize-url. See its options for alternatives.
- get-urls - Get all urls in a string
MIT © Joakim Carlstein
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent