openai_service.cpython-312.pyc•5.24 kB
�
�љh8 � � � d dl Z d dlZd dlZd dlmZmZmZ e j dd� Ze� d�Z e� d�Z
e� d�Z e j dd � d d
gZ e
e j d d � � Z e
e j d
d� � Z e
e j dd� � Zdefd�Zdede
fd�Zdede
ddfd�Zdeeeef dee fd�Zy)� N)�List�Dict�Optional�OLLAMA_API_URLzhttp://127.0.0.1:11434z /api/chatz /api/tagsz /api/show� OLLAMA_MODELztinyllama:latest� tinyllama�DESIRED_NUM_CTX�2048�DESIRED_NUM_PREDICT�256�OLLAMA_NUM_THREADS�0�returnc � � t j t d�� } | j � | j � j dg � D �ch c] }|d �� }}t
D ]
}||v s�|c S t
dt |� � �� �c c}w )N� )�timeout�models�modelu) Uygun model etiketi bulunamadı. Mevcut: )�requests�get�TAGS_EP�raise_for_status�json�MODEL_CANDIDATES� RuntimeError�sorted)�r�m�existings �>/workspaces/MCP-Server/modul3_ders2/services/openai_service.py� _pick_modelr! s� � �� � �W�a�(�A�����$%�F�F�H�L�L��2�$>�?�q��'�
�?�H�?�
� �� ��=��H�� �B�6�(�CS�BT�U�
V�V�� @s � Br c �� � t j t d| id�� }|j � |j � j di � }t
|j d� xs d� S )N�name�
�r r �details�context_lengthi )r �post�SHOW_EPr r r �int)r r r& s r �_get_ctx_trainr+ sV � ��
�
�g�V�U�O�R�@�A������f�f�h�l�l�9�b�)�G� �w�{�{�+�,�4�� 5�5� �num_ctxc
� � | ddt dt |d� � dd�d�}t j t � d�|d �
� j � y # t $ r Y y w xY w) N�pingFi i � �r- � num_predict)r �prompt�stream�optionsz
/api/generate� r% )�max�minr r( �
OLLAMA_URLr � Exception)r r- �payloads r �_warmupr< % sd � �
� � ��#&�s�C���,>�#?�PQ�R�
�� �
�
�� �M�2��"�M�^�^�`�� �
� �
�s �A A � A�A�historyc � � t � }t |� }t t |� }ddd�}|g| z }t
||� |t d�}t dkD r t |d< ||d |d
�} t j t |d � � } | j � | j � }
|
j d
i � j d� S # t $ r}t d|� �� Y d}~yd}~ww xY w# t $ �r}t d|� d�� g } d} t |� D ]= }
t! |
j dd� � }| |z dkD r n| j# |
� | |z
} �? t% t | � � } | |d< t dt � |d d< t j t |d � � }|j � |j � j d
i � j d� cY d}~S # t $ r }t d|� �� Y d}~Y d}~yd}~ww xY wd}~ww xY w)zZ
history: [{"role":"user","content":"..."}, {"role":"assistant","content":"..."}]
u Model/ctx tespiti hatası: N�systemz You are a helpful assistant.)�role�contentr1 r �
num_threadF)r �messagesr4 r5 �x r% �messagerA u Ollama /api/chat hatası: u% – küçültüp tekrar deniyorum...� i� rC � r5 r2 u& Ollama ikinci deneme de başarısız: )r! r+ r8 r r: �printr< r �
NUM_THREADr r( �CHAT_EPr r r �reversed�len�append�list)r= r � ctx_trainr- �e�
system_msgrC r5 r; r �data�short�totalr �c�r2�e2s r �get_ai_responserX 2 s� � ���
��"�5�)� ��o�y�1�� #�/M�N�J��|�g�%�H� �E�7��!�2E�F�G��A�~� *�� � � �8�u�QX�Y�G�� �M�M�'��� =�� ��� ��v�v�x���x�x� �2�&�*�*�9�5�5��+ � �
�+�A�3�/�0�����, � �
�*�1�#�-R�S�T������(�#� (�A��A�E�E�)�B�'�(�A��q�y�4� �� �L�L��O�U�a�Z�U� (�
�X�e�_�%�� #��
��,/��5H�,I�� ��=�)� �� � �w�W�c�B�B� � � � !��7�7�9�=�=��B�/�3�3�I�>� >��� � �:�2�$�?� @��4�� ��#�s\ �%B> �!A C" �> C �C�C �"
H�,B
H�:AG�H� G?�#G:�1H�:G?�?H�H)�osr r �typingr r r �getenvr9 rJ r r) r r* r r rI �strr! r+ r< rX � r, r �<module>r^ s �� � � '� '��b�i�i�(�*B�C�
�� �I�&��� �I�&��� �I�&�� �B�I�I�n� 0�1�� �� � �)�"�)�)�$5�v�>�?���)�"�)�)�$9�5�A�B� ��)�"�)�)�$8�#�>�?�
�W�S� W�6�#� 6�#� 6�
�3�
��
��
�1�T�$�s�C�x�.� 1� 1�h�s�m� 1r,