Popularity

2.3

Declining

Activity

0.3

Declining

Stars 34

Watchers 1

Forks 2

Last Commit about 2 months ago

Programming language: Kotlin

License: Do What The F*ck You Want To Public License

Tags: Web

Latest version: v1.46

sponge alternatives and similar libraries

Based on the "Web" category.
Alternatively, view sponge alternatives based on common mentions on social networks and blogs.

ktor

9.9 9.7 sponge VS ktor

Framework for quickly creating connected applications in Kotlin with minimal effort
javalin

9.7 9.2 sponge VS javalin

A simple and modern Java and Kotlin web framework

Appwrite - The Open Source Firebase alternative introduces iOS support

Appwrite is an open source backend server that helps you build native iOS applications much faster with realtime APIs for authentication, databases, files storage, cloud functions and much more!

Promo appwrite.io

apollo-android

9.4 9.8 sponge VS apollo-android

:robot: A strongly-typed, caching GraphQL client for the JVM, Android, and Kotlin multiplatform.
http4k

9.0 9.7 sponge VS http4k

The Functional toolkit for Kotlin HTTP applications. http4k provides a simple and uniform way to serve, consume, and test HTTP services.
GraphQL Kotlin

9.0 8.6 sponge VS GraphQL Kotlin

Libraries for running GraphQL in Kotlin
jooby

8.8 9.2 L3 sponge VS jooby

The modular web framework for Java and Kotlin
kotlinx.html

8.7 3.9 sponge VS kotlinx.html

Kotlin DSL for HTML
spark-kotlin

8.4 0.0 sponge VS spark-kotlin

A Spark DSL in idiomatic kotlin // dependency: com.sparkjava:spark-kotlin:1.0.0-alpha
kotless

8.4 5.7 sponge VS kotless

Kotlin Serverless Framework
KVision

8.3 9.5 sponge VS KVision

Object oriented web framework for Kotlin/JS
core

7.8 8.8 sponge VS core

A lightweight Kotlin web framework for backend developers 🦆
kara

7.7 0.0 sponge VS kara

Kotlin Web Framework for the JVM
wasabi

7.7 0.0 sponge VS wasabi

An HTTP Framework
firefly

7.6 8.4 sponge VS firefly

Firefly is an asynchronous web framework for rapid development of high-performance web application.
skrape.it

7.4 7.4 sponge VS skrape.it

A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.
hexagon

7.3 9.5 sponge VS hexagon

Hexagon is a microservices toolkit written in Kotlin. Its purpose is to ease the building of services (Web applications, APIs or queue consumers) that run inside a cloud platform.
KGraphQL

7.1 0.0 sponge VS KGraphQL

A GraphQL implementation written in Kotlin
fritz2

7.0 9.9 sponge VS fritz2

Easily build reactive web-apps in Kotlin based on flows and coroutines.
vertx-lang-kotlin

6.8 7.1 sponge VS vertx-lang-kotlin

Vert.x for Kotlin
Kanary

6.7 0.0 sponge VS Kanary

A minimalist web framework for building REST APIs in Kotlin/Java.
A pure Kotlin, UI framework

6.4 9.3 sponge VS A pure Kotlin, UI framework

A pure Kotlin UI framework for the Web (and desktop).
alpas

5.7 0.0 sponge VS alpas

🚀 The Rapid and Delightful Kotlin Web Framework. Easy, elegant, and productive!
kraph

5.7 0.0 sponge VS kraph

GraphQL request string builder written in Kotlin
vaadin-on-kotlin

5.5 8.7 sponge VS vaadin-on-kotlin

Writing full-stack statically-typed web apps on JVM at its simplest
kovert

5.5 0.0 sponge VS kovert

The invisible REST and web framework
krawler

5.0 0.0 sponge VS krawler

A web crawling framework written in Kotlin
yested

4.8 0.0 sponge VS yested

A Kotlin framework for building web applications in Javascript.
KotlinPrimavera

4.6 0.0 sponge VS KotlinPrimavera

Spring support libraries for Kotlin
lambda-kotlin-request-router

4.5 8.2 sponge VS lambda-kotlin-request-router

A REST request routing layer for AWS lambda handlers written in Kotlin
kottpd

4.4 4.2 sponge VS kottpd

REST framework written in pure Kotlin
kog

3.3 0.0 sponge VS kog

🌶 A simple Kotlin web framework inspired by Clojure's Ring.
tekniq

2.8 0.6 sponge VS tekniq

A framework designed around Kotlin providing Restful HTTP Client, JDBC DSL, Loading Cache, Configurations, Validations, and more
kotlin

2.3 0.0 sponge VS kotlin

Starter project for Kotlin
Pellet

2.0 8.0 sponge VS Pellet

An opinionated, Kotlin-first web framework that helps you write fast, concise, and correct backend services 🚀.
bootique-kotlin

2.0 4.6 sponge VS bootique-kotlin

Provides extension functions and features for smooth development with Bootique and Kotlin.
h

1.9 0.0 sponge VS h

Html templating library for kotlin
Zeko-RestApi

1.4 5.5 sponge VS Zeko-RestApi

Asynchronous web framework for Kotlin. Create REST APIs in Kotlin easily with automatic Swagger/OpenAPI doc generation
graphql-kotlin-toolkit

0.9 3.3 sponge VS graphql-kotlin-toolkit

GraphQL toolkit for Kotlin.
komock

0.7 0.0 sponge VS komock

KoMock - Simple HTTP/Consul/SpringConfig http server framework written in Kotlin. Wiremock use cases
voyager-server-spring-boot-starter

0.5 0.8 sponge VS voyager-server-spring-boot-starter

Easily create REST endpoints with permissions (access control level) and hooks includeded
graphql-kotlin

- sponge VS graphql-kotlin

Code-only GraphQL schema generation for Kotlin
kweb-core

- sponge VS kweb-core

Build rich live-updating web apps in pure server-side Kotlin.

* Code Quality Rankings and insights are calculated and provided by Lumnify.
They vary from L1 to L5 with "L5" being the highest.

Do you think we are missing an alternative of sponge or a related project?

Add another 'Web' Library

Popular Comparisons

README

sponge - A website crawler and links downloader command line tool

How to build and run it?

You will need a Java JDK 8+ and maven 3.3.9 or above.

mvn clean package assembly:single

cd target && unzip sponge-X.X-SNAPSHOT.zip && cd sponge-X.X-SNAPSHOT

./sponge [OPTIONS]

How to use it?

Usage: sponge [OPTIONS]

Options:
  -u, --uri VALUE                 URI (example: https://www.google.com)
  -o, --output PATH               Output directory where files are downloaded
  -t, --mime-type TEXT            Mime types to download (example: text/plain)
  -e, --file-extension TEXT       Extensions to download (example: png)
  -d, --depth INT                 Search depth (default: 1)
  -m, --max-uris INT              Maximum uris to visit (default: 1000000)
  -s, --include-subdomains        Include subdomains
  -R, --concurrent-requests INT   Concurrent requests (default: 1)
  -D, --concurrent-downloads INT  Concurrent downloads (default: 1)
  -r, --referrer TEXT             Referrer (default: https://www.google.com)
  -U, --user-agent TEXT           User agent (default: Mozilla/5.0 (X11; Linux
                                  x86_64) AppleWebKit/537.36 (KHTML, like
                                  Gecko) Chrome/80.0.3987.132 Safari/537.36)
  -O, --overwrite                 Overwrite existing files
  -v, --version                   Show the version and exit
  -h, --help                      Show this message and exit

Examples

./sponge -u https://freemusicarchive.org/genre/Blues \
         -o output \
         -e mp3 \
         -d 2 \
         -R 5 \
         -s
...
↓ /home/spypunk/output/files.freemusicarchive.org/storage-freemusicarchive-org/music/no_curator/Checkie_Brown/hey/Checkie_Brown_-_09_-_Mary_Roose_CB_36.mp3 [8 MB] [4145.71 kB/s] [1/19]
↓ /home/spypunk/output/files.freemusicarchive.org/storage-freemusicarchive-org/music/no_curator/Lobo_Loco/Not_my_Brain/Lobo_Loco_-_01_-_Brain_ID_1270.mp3 [8 MB] [4065.18 kB/s] [2/42]
↓ /home/spypunk/output/files.freemusicarchive.org/storage-freemusicarchive-org/music/no_curator/Lobo_Loco/Not_my_Brain/Lobo_Loco_-_02_-_Brain_-_Instrumental_Retro_ID_1271.mp3 [8 MB] [4216.95 kB/s] [3/56]
↓ /home/spypunk/output/files.freemusicarchive.org/storage-freemusicarchive-org/music/no_curator/Lobo_Loco/Salad_Mixed/Lobo_Loco_-_12_-_Madness_is_Everywhere_ID_1228.mp3 [9 MB] [4178.34 kB/s] [4/65]
↓ /home/spypunk/output/files.freemusicarchive.org/storage-freemusicarchive-org/music/no_curator/Lobo_Loco/Salad_Mixed/Lobo_Loco_-_01_-_Allright_in_Lousiana_ID_1234.mp3 [8 MB] [3843.75 kB/s] [5/84]
↓ /home/spypunk/output/files.freemusicarchive.org/storage-freemusicarchive-org/music/no_curator/Lobo_Loco/Salad_Mixed/Lobo_Loco_-_04_-_Peaceful_Morning_ID_1229.mp3 [9 MB] [2889.31 kB/s] [6/85]
↓ /home/spypunk/output/files.freemusicarchive.org/storage-freemusicarchive-org/music/no_curator/Lobo_Loco/Salad_Mixed/Lobo_Loco_-_03_-_Spencer_-_Bluegrass_ID_1230.mp3 [9 MB] [3951.36 kB/s] [7/94]
↓ /home/spypunk/output/files.freemusicarchive.org/storage-freemusicarchive-org/music/no_curator/My_Yearnings/You_get_the_Blues_ID_1201.mp3 [10 MB] [3990.58 kB/s] [8/101]
↓ /home/spypunk/output/files.freemusicarchive.org/storage-freemusicarchive-org/music/no_curator/My_Yearnings/Tropic_Island_-_Clearmix_ID_1172.mp3 [8 MB] [4146.20 kB/s] [9/101]
↓ /home/spypunk/output/files.freemusicarchive.org/storage-freemusicarchive-org/music/no_curator/My_Yearnings/Traveling_Horse_ID_1207.mp3 [6 MB] [3411.93 kB/s] [10/101]
...

./sponge -u https://www.gutenberg.org/ebooks/search/?sort_order=release_date \
         -o output \
         -t text/plain \
         -d 2 \
         -R 5 \
         -D 5
...
↓ /home/spypunk/output/www.gutenberg.org/files/61671/61671-0.txt [34 KB] [202.73 kB/s] [1/1]
↓ /home/spypunk/output/www.gutenberg.org/files/61673/61673-0.txt [363 KB] [778.25 kB/s] [2/3]
↓ /home/spypunk/output/www.gutenberg.org/files/61667/61667-0.txt [280 KB] [359.20 kB/s] [3/4]
↓ /home/spypunk/output/www.gutenberg.org/files/61672/61672-0.txt [953 KB] [149.74 kB/s] [4/4]
↓ /home/spypunk/output/www.gutenberg.org/files/61666/61666-0.txt [866 KB] [438.76 kB/s] [5/6]
↓ /home/spypunk/output/www.gutenberg.org/files/61662/61662-0.txt [556 KB] [625.44 kB/s] [6/6]
↓ /home/spypunk/output/www.gutenberg.org/files/61670/61670-0.txt [140 KB] [397.26 kB/s] [7/7]
↓ /home/spypunk/output/www.gutenberg.org/files/61665/61665-0.txt [74 KB] [277.85 kB/s] [8/8]
↓ /home/spypunk/output/www.gutenberg.org/ebooks/61664.txt.utf-8 [388 KB] [801.17 kB/s] [9/9]
↓ /home/spypunk/output/www.gutenberg.org/files/61661/61661-0.txt [142 KB] [397.52 kB/s] [10/10]
...

./sponge -u https://free-images.com/  \
         -o output \
         -e jpeg \
         -e jpg \
         -e png \
         -d 2 \
         -R 5 \
         -D 5 \
         -s
...
↓ /home/spypunk/output/free-images.com/sm/de66/bees_in_hive.jpg [24 KB] [11229.43 kB/s] [283/300]
↓ /home/spypunk/output/free-images.com/sm/602e/bees_on_flowers_collecting.jpg [15 KB] [70732.48 kB/s] [284/300]
↓ /home/spypunk/output/free-images.com/sm/7491/bees_on_yellow_flowers.jpg [14 KB] [54516.06 kB/s] [285/300]
↓ /home/spypunk/output/free-images.com/sm/e081/bees_pollenating_basil.jpg [15 KB] [57209.33 kB/s] [286/300]
↓ /home/spypunk/output/free-images.com/sm/7e8b/bees_pollenating_insects_bugs.jpg [13 KB] [52990.93 kB/s] [287/300]
↓ /home/spypunk/output/free-images.com/sm/a8ad/bees_pollen_insects_wings.jpg [7 KB] [17312.71 kB/s] [288/300]
↓ /home/spypunk/output/free-images.com/sm/9b0c/bees_really_like_pollinating_0.jpg [11 KB] [66770.38 kB/s] [289/300]
↓ /home/spypunk/output/free-images.com/sm/2d32/delicate_arch_utah_arches.jpg [8 KB] [44408.98 kB/s] [290/300]
↓ /home/spypunk/output/free-images.com/sm/bf50/landscape_arch.jpg [16 KB] [73487.99 kB/s] [291/300]
↓ /home/spypunk/output/free-images.com/sm/0f6a/golden_arches_omaha.jpg [10 KB] [65179.10 kB/s] [292/300]
...

What about license?

This project is licensed under the WTFPL (Do What The Fuck You Want To Public License, Version 2)

This work is free. You can redistribute it and/or modify it under the terms of the Do What The Fuck You Want To Public License, Version 2, as published by Sam Hocevar. See the COPYING file for more details.

*Note that all licence references and agreements mentioned in the sponge README section above are relevant to that project's source code only.

sponge

sponge is a website crawler and links downloader command-line tool