20 points by jerpint a day ago | 9 comments
Just change arxiv.org to arxiv-txt.org in the URL to get the paper info in markdown
Example:
Original URL: https://arxiv.org/abs/1706.03762
Change to: https://arxiv-txt.org/abs/1706.03762
To fetch the raw text directly, use https://arxiv-txt.org/raw/abs/1706.03762, this will be particularly useful for APIs and agents
rrekaf 18 hours ago | root | parent |
do you plan on adding descriptions of figures and tables?
jerpint 14 hours ago | root | parent |
will probably focus on getting the text out of the papers first, figures might be a good next step after that
jmartin2683 a day ago | prev | next |
This would be awesome wrapped in an MCP server/tool call :)
sbpost a day ago | prev | next |
The example you give doesn't seem to work - the raw txt does not have authors.
jerpint 14 hours ago | root | parent |
you're right - I hadn't noticed! I fixed it now, thanks for pointing it out
If you train an LLM on only formally verified code, it should not be expected to generate formally verified code.
Similarly, if you train an LLM on only published ScholarlyArticles ['s abstracts], it should not be expected to generate publishable or true text.
Traceability for Retraction would be necessary to prevent lossy feedback.
lgas a day ago | next |
It just extracts the abstracts?