Urls Open Source Projects

A simple, yet elegant, HTTP library.

Incredibly fast crawler designed for OSINT.

⚡️Faster subsequent page-loads by prefetching in-viewport links during idle time

The comprehensive WSGI web application library.

The Physical Web: walk up and use anything

A Tool for Domain Flyovers

Fetch known URLs from AlienVault's Open Threat Exchange, the Wayback Machine, and Common Crawl.

A macOS app for customizing which browser to start

UILabel drop-in replacement supporting Hashtags (#), Mentions (@) and URLs (http://) written in Swift

iOS Debugging Tool 🚀

持续维护的新浪微博采集工具🚀🚀🚀

Collection of NSFW images URLs for the purposes of training an NSFW Image Classifier

Open stuff like URLs, files, executables. Cross-platform.

⛵️ Elegant URL Routing for Swift

A collection of awesome one-liner scripts especially for bug bounty tips.

WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup a multi-threaded web crawler in less than 5 minutes.

Largest multi-label image database; ResNet-101 model; 80.73% top-1 acc on ImageNet

Gospider - Fast web spider written in Go

Use wicked to turn your controller into a wizard

https://spatie.be/docs/crawler

🌐 The easiest way to parse and modify URLs in Python.

news-please - an integrated web crawler and information extractor for news that just works

Universal dynamic routes for Next.js

A collection of iOS Settings URLs

Library to scrape and clean web pages to create massive datasets.

Loading And Blocking JavaScript: On-demand parallel loader for JavaScript with execution order dependencies

Find broken links, missing images, etc within your HTML.

Robust RSS, Atom, and RDF feed parsing in Node.js

A URL builder library for JavaScript.

Shorten URLs using invisible spaces

Package for downloading things from a string URL using a variety of protocols.

Web vulnerability scanner written in Python3

Download website to local directory (including all css, images, js, etc.)

:rice_scene: Watermarking for the browser

Sitemap-generating framework for node.js

a recon tool that allows searching on URLs that are exposed via shortener services

The Snappy compression format in the Go programming language.

Utility to Automatically Link URLs, Email Addresses, Phone Numbers, Twitter handles, and Hashtags in a given block of text/HTML

Yet another URL library

A long list of App URLs for iOS, macOS and Android

Create custom, lightweight macOS apps from websites

Indexes open directories

Making HTML emails comfortable for the Ruby rockstars

800 bytes modern wrapper around fetch with smart defaults

Pull out bits of URLs provided on stdin

A URL shortener, but it makes the URLs look extremely dodgy instead

Question answering dataset featured in "Teaching Machines to Read and Comprehend

Android ImageView replacement which allows image loading from URLs or contact address book, with caching

Audit URLs using Lighthouse and test performance with Lighthouse CI.

Extract urls from text

A lightweight REST framework that wraps the Apprise Notification Library

Mock Alamofire and URLSession requests without touching your code implementation

Ça trompe énormément

HTML Loader

"Magic Links" - URLs with authentication tokens for one-click login

rhubarb.vim: GitHub extension for fugitive.vim

DEPRECATED. Remove unused CSS selectors.

Example app in React Native: sort of like twitter/tumblr

Purl is a simple Object Oriented URL manipulation library for PHP 7.2+

A tool to fastly get all javascript sources/files