url

Name: url
Author: axoviq-ai

681stars61forks

How to install url?

axoviq-ai/synthadoc/url

$npx -y skills add axoviq-ai/synthadoc --skill url

Installs into the current project.

Summary

Fetch and extract text from web URLs

Files · 1

View on GitHub

SKILL.md

1	# URL Skill
2
3	Fetches a web URL using `httpx`, strips navigation/script/style tags with
4	`BeautifulSoup`, and returns clean body text. PDF URLs are extracted with
5	`pypdf` (primary) and `pdfminer.six` (fallback).
6
7	## Setup
8
9	```bash
10	pip install httpx beautifulsoup4
11
12	# Optional — needed only if you ingest PDF URLs:
13	pip install pypdf pdfminer.six
14	```
15
16	## Standalone usage
17
18	```python
19	import asyncio
20	from synthadoc.skills.url.scripts.main import UrlSkill
21
22	skill = UrlSkill()
23
24	async def main():
25	result = await skill.extract("https://example.com/article")
26	print(result.text) # clean body text
27	print(result.metadata) # {"url": "https://..."}
28
29	asyncio.run(main())
30	```
31
32	`DomainBlockedException` is raised when the site returns HTTP 401, 403, or
33	429. Catch it to log and skip the domain:
34
35	```python
36	from synthadoc.skills.base import DomainBlockedException
37
38	try:
39	result = await skill.extract(url)
40	except DomainBlockedException as e:
41	print(f"Blocked: {e.domain} (HTTP {e.status_code})")
42	```
43
44	## When this skill is used
45
46	- Source starts with `https://` or `http://`
47	- User intent contains: `fetch url`, `web page`, `website`

People who liked this also viewed

6 picks

Type

grill-with-docsA relentless interview to sharpen a plan or design, which also creates docs (ADR's and glossary) as we go.SkillsJul 2026537k182k
lark-minutes飞书妙记：搜索妙记、查看妙记基础信息、下载/上传音视频、读取或编辑妙记的产物内容、改标题、替换说话人/关键词、申请妙记查看/编辑权限。当给出minute_token、本地音视频文件，要查/改/转妙记产物，或用户明确要主动申请妙记权限时使用；本地音视频转纪要/逐字稿优先走本 skill，不要用 ffmpeg/whisper 本地转写。不负责：获取会议关联妙记，或仅按自然语言标题定位纪要SkillsJul 2026379k16k
lark-markdown飞书 Markdown：查看、创建、上传、编辑和比较 Markdown 文件。当用户需要创建或编辑 Markdown 文件、读取、修改、局部 patch 或比较差异时使用。不负责将 Markdown 导入为飞书在线文档，也不负责文件搜索、权限、评论、移动、删除等云空间管理操作。SkillsJul 2026295k16k
docxUse this skill whenever the user wants to create, read, edit, or manipulate Word documents (.docx files) or Word templates (.dotx files). Triggers include: any mention of 'Word doc', 'word document', SkillsJul 2026157k163k
edit-articleSkills for Real Engineers. Straight from my .agents directory.SkillsJul 2026154k181k
lark-note飞书会议纪要（Note）直查：已知 note_id 时查询纪要详情、展示类型、关联文档 token，并读取 unified 原始逐字记录。当用户已持有 note_id，或从文档显式 vc-node-id 获得 note_id 时使用。不负责会议/日程/妙记定位、文档标题搜索或 Docx 正文读取。SkillsJul 2026154k16k