Skip to content

Decouple http retrieval & document extraction - #121

Open
mwjackson wants to merge 2 commits into
grangier:developfrom
knowsis:decouple
Open

mwjackson wants to merge 2 commits into
grangier:developfrom
knowsis:decouple

Conversation

@mwjackson

Copy link
Copy Markdown

We do our own scraping, but rely on goose for the article extraction, so have decoupled the two

so we can use our own crawlers and use goose only for post processing
@matthewrudy

Copy link
Copy Markdown

This makes a lot of sense.
👍

@grangier

Copy link
Copy Markdown
Owner

@mwjackson could you provide exemple how you use this functionality ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants