r/automatewithpython • • Mar 27 '20

Scrapy Tutorial Part 1 - Introduction to Scrapy and Web Scraping

Thumbnail
youtube.com
7 Upvotes

r/automatewithpython • • Apr 01 '15

Liking it so far

5 Upvotes

Got an early access version not long before the final release, and have been puttering through it as time allows (i.e. slowly). Spent an unreasonable amount of time trying to make the practice project(s) at the end of chapter 3 work... turned out that an editor crash had left a swap file, and the recovery had time-jumped my file back to where there was some code that wasn't what I thought it was. No wonder nothing seemed to work!


r/automatewithpython • • Nov 11 '23

Automate Practice

4 Upvotes

You bet your ass this is an automated post. yaaabuddy!


r/automatewithpython • • Aug 26 '22

Thank you Al.

4 Upvotes

Thank you so much al for this book. It is so beginner friendly and very empowering.


r/automatewithpython • • Nov 12 '21

Happy Cakeday, r/automatewithpython! Today you're 7

4 Upvotes

r/automatewithpython • • Sep 16 '20

Create Script That Can Scan Site and Make an Order

4 Upvotes

I'm trying to figure out how I would be able to create a program that can make an order for me as soon as the PS5 pre order page goes live on amazon, bestbuy, and Sony's site.

I realize this may be illegal in some ways but I'm thinking at the very least I can create a program that scans a site and notifies me that a preorder page goes live.

Thoughts? Apologies if I'm posing in the wrong subreddit.


r/automatewithpython • • Mar 27 '20

Automate Data Extraction with Python Webscraping (Playlist)

Thumbnail
self.automation
4 Upvotes

r/automatewithpython • • Mar 19 '22

Phyton or VBA

3 Upvotes

Hi all,

for my work, I very often need to add values from a webpage to excel. People have told me there are ways to automate this process, which would save a lot of time. Right now I do it all manually.
I wanted to ask you, which makes more sense for me to learn Python or VBA? I assume both have pros and cons?

To give you a better perspective, this is one of the websites I would have to extract information from and put it into Excel: https://hoher-spielwert.de/die-haendler/
I always need to extract the name of the organization and the city, which is usually listed below (in bold). Moreover, when you click on one of the organizations it should also extract the email, website, and phone number.

It would be great to get some feedback. For me, it is important to learn the skill such that I can automate this process, a short term solution is not needed. Also, if you know any links with tutorials, it would be greatly appreciated.


r/automatewithpython • • Nov 12 '20

Happy Cakeday, r/automatewithpython! Today you're 6

3 Upvotes

r/automatewithpython • • Apr 03 '26

Workflow Automation PDF Data Extraction, Excel, API

Thumbnail reddit.com
2 Upvotes

r/automatewithpython • • Aug 01 '22

Containerized browser-based environment to automate tasks with Python

2 Upvotes

This is a containerized browser-based environment, which includes VS-Code, visual take scheduler, file-browser, terminal. It can be used to code python scripts and schedule their executions, in the same environment.

You can run it locally or on the server. File browser is handy to download the results.

https://github.com/bluxmit/alnoda-workspaces/tree/main/workspaces/python-automate-workspace


r/automatewithpython • • Jun 21 '22

Automate a mundane task?

2 Upvotes

I have to color in "color by numbers" in order to make pins for pinterest, or ads for my color by number product that I sell. I can do this one section at a time in ms paint 3d. It just takes a while. Is there any way to automate this task? The colors don't even have to be the "right" colors. I just need a colored-in picture to put next to my original color by number to show how it might look. Any ideas?

Thanks!


r/automatewithpython • • Apr 28 '20

Chapter 4 - Lists - Practice Project One "Comma Code"

2 Upvotes

Hello fellow programmers,

I just finished the first programming exercise on the Chapter 4 on the *Automate the Boring Stuff with Python* book, and I appreciate if anyone has some comment to me in order to make my code cleaner and efficient:

# Write a function that takes a list value as an argument and returns a string with all the items separated # by a comma and a space, with and inserted before the last item. # but your function should be able to work with any list value passed # to it. Be sure to test the case where an empty list[] is finalizing # passed to your function

def func(list):

vacia = \[\]

texto = ''

if list == \[\]:

    print('Lista no válida')

else:

    for i in range(len(list)):


        if i == len(list) - 1:

            vacia.append("and " + str(list\[i\]))

            texto = texto + " " + "and " + str(list\[i\])

        else:

            vacia.append(str(list\[i\]))

            texto = texto + " " + str(list\[i\])

    print(vacia)

    print(texto, sep=',')

lista = ['calabaza', 'piña', 'manzana', 'sanahoria']

func(lista)

Thank you all


r/automatewithpython • • Jan 31 '20

Problems installing automate-XXX-requirements.txt

2 Upvotes

OS is Linux Mint 19.3. and in Windows 10

I seem to be stuck on pg 144, where the exercise is to "import pyperclip". We are sent to Appendix A to install third party tools where I get the following output when I run the pip3 command that ends in an error message ending everything.

I have called and emailed No Starch Press looking for an errata sheet that might explain how to get past this and I have sent email to [email protected] but I have not heard from anyone on how to get past this.

The same thing is happening in Windows 10.

Can anybody send me in a direction to resolve this? I would like to continue with the book.

Collecting send2trash==1.5.0 (from -r automate-linux-requirements.txt (line 1))

Using cached https://files.pythonhosted.org/packages/49/46/c3dc27481d1cc57b9385aff41c474ceb7714f7935b1247194adae45db714/Send2Trash-1.5.0-py3-none-any.whl

Collecting requests==2.21.0 (from -r automate-linux-requirements.txt (line 2))

Using cached https://files.pythonhosted.org/packages/7d/e3/20f3d364d6c8e5d2353c72a67778eb189176f08e873c9900e10c0287b84b/requests-2.21.0-py2.py3-none-any.whl

Collecting beautifulsoup4==4.7.1 (from -r automate-linux-requirements.txt (line 3))

Using cached https://files.pythonhosted.org/packages/1d/5d/3260694a59df0ec52f8b4883f5d23b130bc237602a1411fa670eae12351e/beautifulsoup4-4.7.1-py3-none-any.whl

Collecting selenium==3.141.0 (from -r automate-linux-requirements.txt (line 4))

Using cached https://files.pythonhosted.org/packages/80/d6/4294f0b4bce4de0abf13e17190289f9d0613b0a44e5dd6a7f5ca98459853/selenium-3.141.0-py2.py3-none-any.whl

Collecting openpyxl==2.6.1 (from -r automate-linux-requirements.txt (line 5))

Using cached https://files.pythonhosted.org/packages/5f/f8/a5d3a4ab669f99154f87ab531192dd84ac79aae62efab662bd2d82a72194/openpyxl-2.6.1.tar.gz

Complete output from command python setup.py egg_info:

Traceback (most recent call last):

File "<string>", line 1, in <module>

ModuleNotFoundError: No module named 'setuptools'

----------------------------------------

Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-build-6wn0cehs/openpyxl/


r/automatewithpython • • May 04 '15

Having trouble installing the pyautogui Module on my Mac with Yosemite

2 Upvotes

Has anyone had any luck installing it on their mac? I was really excited when I was reading http://automatetheboringstuff.com/chapter18/ but I cant get teh module to work with my computer

I keep getting

Command "python setup.py egg_info" failed with error code 1 in /private/var/folders/h0/xcpmqc0n72bgrt1_zqpgn1xr0000gn/T/pip-build-dq0u8btv/pyobjc-core

when I try to install the framework

and Could not find a version that satisfies the requirement pycore-framework-Quartz (from versions: ) No matching distribution found for pycore-framework-Quartz"""

when I try to install the quartz part


r/automatewithpython • • Feb 27 '24

mute spotify with volume mixer

1 Upvotes

Hello,

I managed to make a script in python to mute spotify, but as I use Voicemetter, the sound from my application comes out of the VAIO3's virtual input and I had moved it to try.

https://pastebin.com/ZR45jvzV

Could you tell me what I should change?


r/automatewithpython • • Dec 17 '23

Need help with social media listening and auto-reply to user's message

1 Upvotes

Hello folks,

I need help and ideas to come up with a solution requested by my company. I especially need help for point #3, but if you have an overall existing solution or are willing to develop a solution like this, let me know and maybe we can work something out.

In short, the company needs an automated and constant listening/monitoring on social media for mentions of their brands and competitors, and then automatically write to the user's to empathize and try to resolve any issues. A more descriptive request is as follows:

1. Solution needs to automatically and constantly listen/monitor social media for mentions of their brand and competitors.

1.1. The definition of 'mentions' should be actual tags or keywords written on social media posts.

1.2. Listening should capture mentions independently on where they were written, either on wall/feed of the company's or the user's.

2. This data should be stored in a database, the minimum fields should be as follows: timestamp, link for the user's profile, description of the message, classification of the intent (negative/neutral/positive), if emojis can be translated or interpreted into sentiment then even better. The small preference on the database is that it's opensource and accesible from internet (eg mysql, baserow, nocodb, etc), but the company is willing to go with commercial db that have easy front-end dev like Knack.

3. For each of the records from the previous point, there should be a bot or automation that from the company's profile a message should be written to the user's profile. Message should be rather simple, thanking the user for the message, ask how they can improve if the sentiment was neutral/negative, and offer a coupon or discount for future visits.

3.1. This automatic message should be an invitation so the user continues the conversation with the company, where subsequent messages should be replied by the company's bot.

I especially need help with point #3, since I haven't been able to find an automated solution that initiates a message from the company's profile to the users's; right now only ideas are with RPA or a headless browser, but I would definitely like something that can be integrated with n8n or be consumed as a microservice or API.

For point #1 I haven't tried it but I believe there are some social media listening APIs or at least webscraping that I could use, but I haven't landed on a 'all in one' solution for major social medias like Instagram, Facebook and TikTok, so I'm open to suggestions.

Thank you very much in advance.


r/automatewithpython • • Jul 26 '23

YDEP (Youtube Show Poster)

Thumbnail self.python
1 Upvotes

r/automatewithpython • • Nov 12 '22

Happy Cakeday, r/automatewithpython! Today you're 8

1 Upvotes

r/automatewithpython • • Jul 26 '22

automate PPT from email.

1 Upvotes

Hello, I have a task where I refresh PowerPoint presentations every month. I receive email in which there are multiple excel workbooks. I use the data in the excel sheets to create graph and then copy and paste it in PowerPoint. Is there a way to automate this process?

I have knowledge of SQL, powerbi, powerautomate.


r/automatewithpython • • Feb 22 '22

Working with Excel spreadsheets / Formulas

1 Upvotes

From the textbook "Automate the Boring Stuff" (page 320, Chapter Working with Excel Spreadsheets):

Excel formulas offer a level of programmability for spreadsheets but can quickly become unmanageable for complicated tasks. For example, even if you're deeply familiar with Excel formulas, it's a headache to try to decipher what =IFERROR(TRIM(IF(LEN(VLOOKUP(F7, Sheet2!$A$1:$B$10000, 2, FALSE))>0,SUBSTITUTE(VLOOKUP(F7, Sheet2!$A$1:$B$10000, 2, FALSE)," ", ""),"")), "") actually does. Python code is much more readable.

I am not sure what the author tries to say. How could Python code improve or simplify this Excel formula? I mean Python and openpyxl offer methods, functions, attributes to navigate through spreadsheets and edit them. But the formulas that do the job, they are given by Excel. We can only write the formulas as Python string into the cells, but the syntax is defined by Excel. Am I wrong?

What does the author exactly mean, when he says "Python code is much more readable" in that specific case?


r/automatewithpython • • Apr 19 '21

How to learn python

1 Upvotes

Hi, I am trying to learn python by my own so I need some advice. What do you recomend me to do or read in order to learn python? (also different ways to learn it)


r/automatewithpython • • Jan 26 '21

Client/Server command & control (existing projects or home grown)

1 Upvotes

Hello!

Wondering if anyone has any knowledge of, implemented, or written your own project used for remotely managing a cluster of devices? I want to use a server to remotely administer multiple clients that would be NAT'd (behind a cable modem/router). In my particular case I'd want to remotely instruct each client to run a speed test against the same server that's remotely managing the clients. Again the problem is that I don't directly have reachability to the clients so they will need to establish a reverse tcp connection to the server and then I'd send commands down to the clients. I'm not sure if there is any software that already exists to do this or if I'd need to write my own for the client and server respectively.


r/automatewithpython • • Dec 23 '20

Zoom Meeting SDK

1 Upvotes

Can I access zoom meeting participant's camera data through python code ?