Nulo/preciazo
1
0
Fork 0
mirror of https://github.com/catdevnull/preciazo.git synced 2025-02-17 00:24:05 +00:00
Code Issues Projects Releases Packages Wiki Activity

*** son warcs no tar

Browse source
This commit is contained in:
Cat /dev/Nulo 2023-12-27 22:16:20 -03:00
parent c217161d21
commit 254a068091
1 changed files with 2 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
readme.md
View file

@ -22,7 +22,7 @@ empezá descargando un WARC con 50 páginas de sample, y recomprimilo con zstd:
```
wget --no-verbose --tries=3 --delete-after --input-file ./data/samples/Dia.txt --warc-file=dia-sample
gzip -dc dia-sample.warc.gz | zstd --long -15 --no-sparse -o dia-sample.tar.zst
gzip -dc dia-sample.warc.gz | zstd --long -15 --no-sparse -o dia-sample.warc.zst
```
después, scrapealo a una BD:
@ -30,7 +30,7 @@ después, scrapealo a una BD:
```
cd scraper/
bun install
bun cli.ts scrap ../dia-sample.tar.zst
bun cli.ts scrap ../dia-sample.warc.zst
```
ahora miralo en el sitio: