WebSearch

� 82�g���d�dd
lm
Z

ddlmZ
ddlmZ
ddlmZ
e��
Gd�d��ZdS)�)
�OpenAI)
�load_dotenv)
�TavilyClient)
�FirecrawlAppc�r�eZ
dZdd�Zdefd�Zdededefd �Zdeed e dede fd �Z deefd�ZdS)�WebTools�returnNc
�x�t
��|_
t��|_t ��|_dS)
N)r�clientr� tavily_clientr� firecrawl)
�selfs
�LD:\Mis_Docs\Programming\Proyectos\Python\IA\mcps\WebSearch\tools\webtools.py�__init__zWebTools.__init__s(���h�h���)�^�^���%��������queryc�� |j�
|
�
�
}|S#t$r}d
t|�
�
��cYd}~Sd}~w
wxYw
)NzError performing search: )r �search� Exception�str)rr�response�
es rrzWebTools.searchsc�� 8��~�,�,�U�3�3�H��O���
8�
8�
8�7�s�1�v�v�7�7�7�7�7�7�7�7�����
8���s�� A�?�
A�A�url�maxDepth�limitc�� |j�
|
||d
ddgi
d�d���}|S#t$r}dt|�
�
��cYd}~Sd}~w
wxYw
)N�formats�markdown�html)rr� scrapeOptions�)�params� poll_intervalzError crawling pages: )r � crawl_urlrr)rrrr� crawl_pagers r�crawlzWebTools.crawls��� 5���1�1��"� (�&/�*�f�1E�%F��� !�2���J�����
5�
5�
5�4�C�
�F�F�4�4�4�4�4�4�4�4�����
5���s�&)� A�A �
A� A�enableWebSearch�prompt�showSourcesc �� |j�
|
|||d
g
dd�d���}|S#t$r}d|
�dt|�
�
��cYd}~Sd}~w
wxYw
)NrT)r�blockAds)r(r'r)r z'Error extracting information from page �: )r �extractrr)rrr'r(r)�info_extractedrs r�extract_infozWebTools.extract_info&s��� M
�!�^�3�3��$�'6�#.�$.�<�$(�&�&� ����N�"�!���
M
�
M
�
M
�L�S�L�L�C�
�F�F�L�L�L�L�L�L�L�L�����
M
�����%(� A�A�
A�Ac�� |j�
|
d
dgddi
g
d����}|S#t$r}d|
�dt|�
�
��cYd}~Sd}~w
wxYw
) Nrr�type� screenshot)r�actions)
r"zError scrapping ulr r,)r � scrape_urlrr)rr�urls_scrapedrs r�scrape_urlszWebTools.scrape_urls:s��� :��>�4�4�� *�F�3���.� ���5���L� ����
:�
:�
:�9�#�9�9��Q���9�9�9�9�9�9�9�9�����
:���r0)r N)�__name__� __module__�__qualname__rrr�intr&�list�boolr/r7�rrrr s�������(�(�(�(� 8�C�8�8�8�8� 5�� 5�� 5�C� 5� 5� 5� 5�M
���9�M
�/3�M
�=@�M
�OS�M
�M
�M
�M
�( :�t�C�y� :� :� :� :� :� :rrN) �openair�dotenvr�tavilyrr rrr>rr�<module>rB
s��


�������������������"�"�"�"�"�"�
�� � � �=
:�=
:�=
:�=
:�=
:�=
:�=
:�=
:�=
:�=
:r