Official Substack MCP Server

� �@�g����SrS
SK
r
S
SKJr S
SKJr S
SKrS
SKrS
SKrS
SKJ r S
SK JrJr \
R"\5
r"SS\5rg) z/ Substack scraper for Writer Context Protocol. �N)
�datetime)
�List)
� BeautifulSoup)�BaseScraper�Postc�H�\r
SrS
rSrS\\4Sjr\S\ S\ 4Sj5r Srg) �SubstackScraper�zScraper for Substack blogs.�returnc
��b# �[RS
UR35
[R"SS9

I
Shv
�Nn
U
RURS35
IShv
�NnUR 5 [R"UR5
n[RS[UR5
35
SSS5IShv
�N /nWRSUR H�nS U;aUR"S R$OUR&n[)US5nUR+UR-SSS 95
n Sn [/US5(a"[0R2"UR4S5n [;UR+UR<5
UR>U U SS9nURAU5
M� [RS[U5
S35
U$G
N�G
N�G
N!,IShv
�N(d
f  G
N4=f
![Ra$n[RSU35
/sSnA$SnAf
[a-n[RS[U5
35
/sSnA$SnAf
f=f
![6aZ [0R2"UR4S5n G
N,![6a' [R9SUR435
G
N\f=f
f=f
![a@n[RSURSS5S[U5
35
SnAGM8SnAf
f=f
7f
)zc Scrape posts from a Substack blog. Returns: A list of Post objects with content and metadata zFetching Substack posts from: T)
�follow_redirectsN�feedzNumber of entries in feed: zHTTP error: zError fetching Substack feed: �contentrzhtml.parser�
)� separator�strip� publishedz%a, %d %b %Y %H:%M:%S %zz%a, %d %b %Y %H:%M:%SzCould not parse date: �)�title�urlr�date�subtitlezError processing Substack post �link�unknownz: zScraped z posts from Substack)!�logger�infor�httpx�AsyncClient�get�raise_for_status� feedparser�parse�text�len�entries�HTTPStatusError�error� Exception�str� max_postsr�value�summaryr�_clean_content�get_text�hasattrr�strptimer� ValueError�warningrrr�append)�self�client�responser�
e�posts�entryr�soup�cleaned_text�pub_date�posts �O/Users/jonathanpolitzki/Desktop/Coding/mcp-writer-substack/scrapers/substack.py�scrape�SubstackScraper.scrapes���� ��K�K�8���� �C�D��(�(�$�?�?�6�!'���t�x�x�j��,=�!>�>���)�)�+�!�'�'�� � �6�����9�#�d�l�l�:K�9L�M�N� @
�?����\�\�/�4�>�>�2�E� i
�4=��4F�%�-�-�
�*�0�0�E�M�M��$�W�m�<��#�2�2�4�=�=�3�VZ�=�3[�\�� ���5�+�.�.�W
�#+�#4�#4�U�_�_�F`�#a����-�-�e�k�k�:�� � �(�!�������T�"�53�< ���h�s�5�z�l�*>�?�@���Y
@
�>�@
�?�?�?�� �$�$� ��L�L�<�
�s�+�,��I��� ��L�L�9�#�a�&��B�C��I�� ��"&�W
�W
�'/�'8�'8����Ja�'b�H��)�
W
�"�N�N�-C�E�O�O�CT�+U�V�V�
W
�� W
���
i
����>�u�y�y��QZ�?[�>\�\^�_b�cd�_e�^f�g�h�h��
i
�s
�
L/
�:H�
G'�H�"G0�$
G*�%AG0�H�
G-�H�L/
�3A)K"�!I;�>A
K"�?(L/
�'
H�*
G0�-
H�0H�6
G9�7H�H�L/
�H�I8�H>�8
I8�9L/
�> I8�"I3�-
I8�.L/
�3I8�8L/
�; K�!J*�'K"�*,K�
K�K"�
K�K�K"�" L,�,4L'� L/
�'L,�,L/
rc
�R�[R"S
SU5R5nU$)z+Remove extra whitespace and normalize text.z\s+r)�re�subr)
rs
r>r-�SubstackScraper._clean_contentLs$���&�&���g�.�4�4�6�����N)�__name__� __module__�__qualname__�__firstlineno__�__doc__rrr?�staticmethodr)r-�__static_attributes__rFrEr>r r s8��%�5�d�4�j�5�n
�������rEr )rK�loggingr�typingrrBr!r�bs4r� scrapers.baserr� getLoggerrGrr rFrEr>�<module>rS
s@�


�
�
��� ����+� � � �8� $��?
�k�?
rE