Блог

Как мне решить AttributeError: 'NoneType' object has no attribute 'text' при использовании BeautifulSoup?

ниже приведен текущий код, который у меня есть.

 from bs4 import BeautifulSoup
import urllib.request

with open('websites_mn.txt') as f:
    txtdata = f.readlines()

for raw_url in txtdata:
    raw_url = raw_url.strip('n')
    url = urllib.request.urlopen(raw_url)
    content = url.read()
    soup = BeautifulSoup(content, 'lxml')
    table = soup.findAll('div',attrs={"class":"journal-content-article"})
    for x in table:
        print(x.find('p').text)
  

вот текстовый файл веб-сайтов.

 https://mongolia.mid.ru:443/en_US/novosti/-/asset_publisher/hfCjAfLBKGW0/content/24-avgusta-sostoalas-vstreca-crezvycajnogo-i-polnomocnogo-posla-rossijskoj-federacii-v-mongolii-i-k-azizova-s-ministrom-energetiki-mongolii-n-tavinbeh?inheritRedirect=falseamp;redirect=https://mongolia.mid.ru:443/en_US/novosti?p_p_id=101_INSTANCE_hfCjAfLBKGW0&p_p_lifecycle=0&p_p_state=normal&p_p_mode=view&p_p_col_id=column-1&p_p_col_count=1
https://mongolia.mid.ru:443/en_US/novosti/-/asset_publisher/hfCjAfLBKGW0/content/19-avgusta-2020-goda-sostoalas-vstreca-crezvycajnogo-i-polnomocnogo-posla-rossijskoj-federacii-v-mongolii-i-k-azizova-s-zamestitelem-ministra-inostran?inheritRedirect=falseamp;redirect=https://mongolia.mid.ru:443/en_US/novosti?p_p_id=101_INSTANCE_hfCjAfLBKGW0&p_p_lifecycle=0&p_p_state=normal&p_p_mode=view&p_p_col_id=column-1&p_p_col_count=1
https://mongolia.mid.ru:443/en_US/novosti/-/asset_publisher/hfCjAfLBKGW0/content/vsemirnye-zimnie-igry-special-noj-olimpiady-2022-goda-projdut-v-kazani?inheritRedirect=falseamp;redirect=https://mongolia.mid.ru:443/en_US/novosti?p_p_id=101_INSTANCE_hfCjAfLBKGW0&p_p_lifecycle=0&p_p_state=normal&p_p_mode=view&p_p_col_id=column-1&p_p_col_count=1
https://mongolia.mid.ru:443/en_US/novosti/-/asset_publisher/hfCjAfLBKGW0/content/mezdunarodnyj-voenno-tehniceskij-forum-armia-2020-projdet-v-period-s-23-po-29-avgusta-2020-goda-na-territorii-kongressno-vystavocnogo-centra-patriot-?inheritRedirect=falseamp;redirect=https://mongolia.mid.ru:443/en_US/novosti?p_p_id=101_INSTANCE_hfCjAfLBKGW0&p_p_lifecycle=0&p_p_state=normal&p_p_mode=view&p_p_col_id=column-1&p_p_col_count=1
https://mongolia.mid.ru:443/en_US/novosti/-/asset_publisher/hfCjAfLBKGW0/content/crezvycajnyj-i-polnomocnyj-posol-rossijskoj-federacii-v-mongolii-i-k-azizov-vstretilsa-s-ministrom-obrazovania-i-nauki-mongolii-l-cedevsuren-v-hode-be?inheritRedirect=falseamp;redirect=https://mongolia.mid.ru:443/en_US/novosti?p_p_id=101_INSTANCE_hfCjAfLBKGW0&p_p_lifecycle=0&p_p_state=normal&p_p_mode=view&p_p_col_id=column-1&p_p_col_count=1
https://mongolia.mid.ru:443/en_US/novosti/-/asset_publisher/hfCjAfLBKGW0/content/10-iula-sostoalas-vstreca-crezvycajnogo-i-polnomocnogo-posla-rossijskoj-federacii-v-mongolii-i-k-azizova-i-ministra-inostrannyh-del-mongolii-n-enhtajv?inheritRedirect=falseamp;redirect=https://mongolia.mid.ru:443/en_US/novosti?p_p_id=101_INSTANCE_hfCjAfLBKGW0&p_p_lifecycle=0&p_p_state=normal&p_p_mode=view&p_p_col_id=column-1&p_p_col_count=1
https://mongolia.mid.ru:443/en_US/novosti/-/asset_publisher/hfCjAfLBKGW0/content/prezident-rossijskoj-federacii-v-v-putin-pozdravil-prezidenta-mongolii-h-battulgu-s-nacional-nym-prazdnikom-naadam-?inheritRedirect=falseamp;redirect=https://mongolia.mid.ru:443/en_US/novosti?p_p_id=101_INSTANCE_hfCjAfLBKGW0&p_p_lifecycle=0&p_p_state=normal&p_p_mode=view&p_p_col_id=column-1&p_p_col_count=1
https://mongolia.mid.ru:443/en_US/novosti/-/asset_publisher/hfCjAfLBKGW0/content/predsedatel-pravitel-stva-rossijskoj-federacii-m-v-misustin-pozdravil-prem-er-ministra-mongolii-u-hur?inheritRedirect=falseamp;redirect=https://mongolia.mid.ru:443/en_US/novosti?p_p_id=101_INSTANCE_hfCjAfLBKGW0&p_p_lifecycle=0&p_p_state=normal&p_p_mode=view&p_p_col_id=column-1&p_p_col_count=1
https://mongolia.mid.ru:443/en_US/novosti/-/asset_publisher/hfCjAfLBKGW0/content/inistr-inostrannyh-del-rossijskoj-federacii-s-v-lavrov-pozdravil-ministra-inostrannyh-del-mongolii-n-enhtajvana-s-naznaceniem-i-nacional-nym-prazdniko?inheritRedirect=falseamp;redirect=https://mongolia.mid.ru:443/en_US/novosti?p_p_id=101_INSTANCE_hfCjAfLBKGW0&p_p_lifecycle=0&p_p_state=normal&p_p_mode=view&p_p_col_id=column-1&p_p_col_count=1
https://mongolia.mid.ru:443/en_US/novosti/-/asset_publisher/hfCjAfLBKGW0/content/pozdravlenie-crezvycajnogo-i-polnomocnogo-posla-rossijskoj-federacii-v-mongolii-i-k-azizova-s-nacional-nym-prazdnikom-mongolii-naada-1?inheritRedirect=falseamp;redirect=https://mongolia.mid.ru:443/en_US/novosti?p_p_id=101_INSTANCE_hfCjAfLBKGW0&p_p_lifecycle=0&p_p_state=normal&p_p_mode=view&p_p_col_id=column-1&p_p_col_count=1
  

Вместо того, чтобы печатать все теги p в div с помощью journal-content-article, он останавливается из-за ошибки NoneType.

В вашем цикле вы можете проверить, существует ли объект, прежде чем обращаться к атрибуту:

 for x in table:
    if x.find('p'):  # add this check
       print(x.find('p').text)