r/pythonhelp • • Apr 27 '22

Python code beginner

i have a code im working on and I need help if anyone can help please,

where im defining a function:

def function(sentence, stop_words):

in which i am trying to remove all the words in the string stop_words that are present in the sentence.

I am writing this for output:

simple_sentence = stop_word_removal("This is some sentence and I know it is a long one", "and is I") print(simple_sentence)

And I need this for output:

This some sentence know it a long one

2 Upvotes

8 comments sorted by

1

u/itachiwasright Apr 27 '22

def stop_word_removal(sentence, stop_words):

""" Returns new sentence with removed stop words. """

stop_words = stop_words.split()

s = sentence

for c in stop_words:

s = s.replace(c,'').replace(' ',' ')

return s

Ive tried this code above ^

but the output is:

Th some sentence know it a long one

instead of: This some sentence know it a long one

1

u/throwaway8u3sH0 Apr 28 '22

Pretty good. You're close. The problem is that you're replacing the stop words in the entire sentence, instead of comparing individual words. So you're removing "is" (the word), but also removing the letters "is" from "This", which is not what you want.

I'm surprised someone suggested looping over the stop words. The technical term for what you're doing is filtering. You're filtering words out of a sentence when they satisfy a condition. (When you get to more advanced Python, you can do things like this in a single line: " ".join(filter(lambda x: x not in stop_words.split(), sentence.split()))). But it's important to learn it with loops first.

Personally, I would do the following:

  • split both the sentence and the stop words into lists of words.

  • Loop over the words in the sentence, checking if each word is in the stop list. You can test if a word is in a list in python with something like if word in myList.

    • If it's not, I'd add it to an output list.

    • If it is, I'd skip it (do nothing).

  • Lastly, you'll need to join() the output list back together with spaces to make a sentence again.

Good luck!

1

u/bulaybil Apr 27 '22

First question: do you have a list of stop words?

1

u/itachiwasright Apr 27 '22

Yes, the stop_words are "and is I" giving in the simple sentence =,

the stop words can also be of any length given as it is a string

2

u/CraigAT Apr 27 '22

You might want to look up the "split" function to give you a list of the individual words in the stop_words, you could then loop through those words and search if the current stop_word was in the sentence and remove it. Note you will have to check whether it was a full or part word within the sentence.

1

u/skellious Apr 27 '22

if doing this, DO NOT try to modify the words during looping through them, instead create a new output.

if you modify while looping you may run in to issues.

1

u/CraigAT Apr 27 '22 edited Apr 27 '22

Wouldn't you only run into issues if you were modifying the list you were looping through.

But in this instance you would be looping through the list (of stop_words) and amending a separate string (the sentence).

1

u/skellious Apr 27 '22

depending on how the fucntion is written it might do that. I'm saying to avoid writing it that way.