Add agent component for web crawler (#2878)

### What problem does this PR solve?

Add agent component for  web crawler

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
This commit is contained in:
wwwlll
2024-10-21 11:38:41 +08:00
committed by GitHub
parent c1d0473f49
commit 4bdf3fd48e
9 changed files with 152 additions and 0 deletions

View File

@@ -928,6 +928,16 @@ The above is the content you need to summarize.`,
yahooFinance: 'YahooFinance',
yahooFinanceDescription:
'The component queries information about the company based on the provided ticker symbol.',
crawler: 'Web Crawler',
crawlerDescription:
'This component can be used to crawl HTML source code from a specified URL.',
proxy: 'Proxy',
crawlerResultOptions: {
html: 'Html',
markdown: 'Markdown',
content: 'Content',
},
extractType: 'extractType',
info: 'Info',
history: 'History',
financials: 'Financials',