I've attempted swing and daytrading on and off for years, and never consistently profitable. I underestimated the mental aspect, the dedication required, and more. But I still love the markets, so I'm giving algo trading a try.
I'm posting here in part for accountability to myself and for help & feedback from others. Also hoping to find some like-minded folk that build algo trading systems. Part of why I think I'm unsuccessful so far is the lack of any sort of support or circle of people to trade with.
Here my plan for developing an automated strategy.
Markets - research which markets, timeframe and holding period is viable for a retail algo trader.
System & Data - determine which backtesting and data sources to use.
Experiment - brainstorm some preliminary ideas, start experimenting, and learn how to backtest and use the data.
Forward test - anything that looks promising.
Live trade! - we'll see about this one. I'm excited, but not getting ahead of myself.
Markets. The important things I'm looking for here are: data availability, retail edge, and the volume of opportunity (enough names / events to trade). I consider the following asset classes:
US stocks: cheap data, free fundamentals (EDGAR), thousands of names, lots of daily and swing opportunities.
Futures: affordable live data, not as many opportunities.
Options: expensive and complex data. May be a viable trading vehicle if trading US stocks.
Forex: cheap price data, only a limited number of pairs. Limited opportunity
Crypto: free data, trades 24/7, but no fundamentals. Limited opportunities compared to stocks.
I decided for now to go with US stocks because of the opportunity (thousands of instruments, and other asset classes through ETFs) and relatively easy access to the same price and fundamental data as the big players do.
For deciding on a timeframe and holding period (which will determine what data and features a testing platform will need) I'm looking for timeframe and holding period where a retail trader has advantages (ideally), or at least where the disadvantages of being a small player can be mitigated.
Sub-second: HFTs and market makers. Colocated. Special equipment required.
Seconds: High speed algos. Possibly colocated. Commission costs.
Minutes to hours: Day traders, prop firms.
Days to weeks: Swing traders, hedge & quant funds. Data mostly accessible, except their alt data.
Months+ Mutual funds, pensions. Public data only.
After some research, I decided on US stocks, with a minimum data timeframe of 1 min, but more likely a timeframe of hours to weeks. It's a wide timeframe but I expect individual strategies will focus on a narrow section of it. Who are we trading against at this timeframe? This should put us out of the way of HFTs, high speed algos, and market makers, and into the realm of day traders, prop firms, and swing traders. I'm no expert in this, so any feedback on this would be appreciated.
On the data side, SEC data is in the cards, as well as other free sources like the FOMC schedule and historical rate decisions, and some of the larger economic calendars like bond sales, CPI and NFP. All easily available and free to get into a testing system.
Next steps! Grab a few years of minutely and daily bars for US stocks and start looking into some testing platform. Or like everyone else seems to be doing these days vibe code up some fancy dashboards.
Any feedback on, well... any of this would be appreciated! Especially in the thought process and the decisions made.