So I've been trying to get Beautifulsoup4 to work on both Eclipse IDE and PyCharm IDE. I've uninstalled the former before I installed the latter and then I installed (successfully) Beautifulsoup4 into the scripts folder of my current version of python. Wondering why PyCharm IDE will not recognize the code 'from bs4 import BeautifulSoup' and is currently greyed out, showing the there is no module. Has anyone else had this issue running this particular module on PyCharm? I have also tried installing it through the PyCharm settings tool in what seems to no avail.


If the package

from bs4 import BeautifulSoup

is greyed out this means that you have successfully installed the BeautifulSoup package on the PyCharm IDE, but you haven't used it in your program.

To use the package you have to follow three steps:

  1. Step 1:
    For reference paste this link... https://www.pythonscraping.com/pages/warandpeace.html
url = "Paste the given link here"

Here url is the variable you are storing the website URL.

  1. Step 2:
    Now you have open the URL which you want to access and which you have stored in the URL variable earlier.
    For opening the URL you have to import a package... which is
from urllib.request import urlopen

Now you have to do this step:

HtmlContent = urlopen(url)

In above line HtmlContent is a variable where you will store the opened URL HTML data.

  1. Step 3:
    Now to use the BeautifulSoup package you have to create an object... below is the way to access the BeautifulSoup...
soup = BeautifulSoup(HtmlContent.read(), "lxml")

In above line "lxml" is an HTML parser which you have install in PyCharm terminal... below is the command...

# pip install lxml

So this is the way you can access the BeautifulSoup package in you PyCharm IDE
Thank you

For more further details on BeautifulSoup you can access it through this link: https://www.crummy.com/software/BeautifulSoup/bs4/doc/

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.