r/cbaduk • • Feb 18 '18

Current state of computer Go?

99 Upvotes

I recall back in around 2015, after first hearing about the AlphaGo version that beat Fan Hui, and the upcoming grand match/challenge that was supposed to take place in March of the following year against Lee Sedol, that at the time the strongest commercially available desktop version of a PC Go AI game was probably Crazy Stone. I was introduced to Crazy Stone after reading a Wired article that predicted it would be ten years at least for there to be an AI that bested top professionals. Some even thought it would never be possible.

It was a major excitement to me, at the time, when finally a “Deep Learning” version of Crazy Stone was made available and its creator purported it to be 7dan strength, and nearly 90% winrate against the then 2013 (non-DL) previous version of Crazy Stone, which up until AlphaGo was the best yet, with it even once winning against a Pro by getting 4 stone handicap from him.

Being someone who is interested in Go and the AI aspect of computer Go, but always relatively weak in the actual skillset and mechanics of playing the game, (around 25 kyu or thereabouts) I kept my ears open and soon heard about an up and coming contender called “Leela”. At first I thought what a funny name, but then over time I realized that Leela also started encorporating a deep learning version that made it far stronger, and although it wasn’t open source or anything it was completely free (unlike Crazy Stone which costs $80) and I really liked the heat maps and other functionality that were sorely lacking in Crazy Stone (Crazy Stone btw still had an User Interface reminiscent of the Windows 95 era, and absolutely no scaling and was basically unbearable on a 4k display), plus since I had a fairly beefy graphics card at the time, very quickly I realized that Leela was going to be far stronger on my setup than CrazyStone could ever hope to be (being that CS was only CPU and not using GPU such as the likes of Leela)

Fast forward couple more months and there is talks about an even stronger AI bot by the name of Ray or Rayon or whatever. And that better than Leela, Ray was not only open source but it scaled to more than one graphics card as long as one had the CUDA/Nvidia platform. That was pretty exciting news to me, but unable to get it to compile on my own, I downloaded the latest binary executable and ran it on the Sabaki gui against Leela and was shocked to find out that in all my tests no matter which parameters I used that Leela beat Ray each and every time. So in any case I went back to Leela and by this point Crazy Stone was all but a distance memory of the past.

Fast forward a bit more, AlphaGoZero research paper is published and the creator of Leela was once again quick to jump on the bandwagon and started implementing a “Leela Zero” version of Leela. At first I imagined this was purely academic and just for kicks and that it would be years before Leela Zero had any hopes of gaining parity with the then strongest version of Leela 11. But soon LZ gained lots of ground, and with the latest network [e1156879 ] being well over 8000 ELO it seems like it is basically already on par with the Leela 11, if not even stronger than it!

Recently for the first time I kept hearing word of this new bot called “AQ” and that it is stronger than Ray and also than Leela 11 and that unlike Leela this AQ is fully open source. However talk in town is that now with the imminent and impeding release of LeelaZero Next version and sporting the latest >8000 ELO self-learning networks that pretty soon LZ will catch up to AQ if not shortly thereafter surpass it altogether.

In recent weeks, Nick Sibicky’s Go friend Andrew Jackson of Google and friends posted on reddit and github and elsewhere that they are doing an AlphaGoZero recreation as well, and from what I can gather, it will be a more faithful recreation than the Leela Zero and one major difference is that it won’t be distributed crowd sourced but rather it will be ran on Google’s own homegrown cloud TPU resources.

No matter what happens, this is an exciting time for computer Go and even Go in general, in that in the span of a few short years we went from the then state of the art non-DL CrazyStone needing to get from an average pro about four or five handicap stones to even hope to be able to score an win, to very soon multiple publically available and open source /free AI go programs that will be bona fide Pro level or above, reaching and perhaps soon surpassing the Fan Hui version of AlphaGo. This isn’t even taking into account other bots like DeepZen, FineArt, etc that which aren’t publically available for use, it seems we are witnessing for the first time in thousands of years of Go history a sort of “Convergence” to perfect play or near perfection level of play, with so many tools reaching superhuman levels in such sort periods of time.

We are fastly entering the age in which everyone can run the equivalent of AlphaGo on their own desktops, as AI strength reaches parity with convergence to perfection, and computer “Go” becoming “solved” in much the same way as Computer Chess already has been for decades, perhaps ultimately there will be a return of interest in/to humans playing Go against other humans merely for the intrinsic value it provides and the aesthetic and visceral satisfaction that it affords. In that sense, AI bots can be viewed as human teachers, a great equalizer and vast multiplier of Go learning efforts, offering insights, perspectives, and as a forms and means of augmentation and supplementation that never before in the history of the game has been ever been possible before. AI here can be used as a democratization of knowledge, leveling the playing field, where any adult or child can have instant access to the best of “Go teachers”, at zero cost, forever. I believe in the age of AI besting humans at everything, the question will no longer be “what do you do best”, or “how good are you”, but that of “what are your true passions, hobbies and interests” based on the metric of intrinsic excitement and intentionality of curiosity, irregardless of skill level or mastery.


r/cbaduk • • Jan 30 '18

An open-source implementation of the AlphaGoZero algorithm

Thumbnail
github.com
67 Upvotes

r/cbaduk • • Mar 28 '18

My thoughts and reflections on AlphaGo and now MiniGo

56 Upvotes

http://archive.is/mdk7r

My two cents on the Google situation, I'm grateful for their publish of the two papers, without which it almost certainly will be the case that today there wouldn't have been free open source zero bot (LZ) of pro levels. And I'm realistic and cognizant of the fact that as a company they have the prerogative to do things in their own best interest and do not "owe" the Go community anything at all. Having said that, I recall in the past the developers stated that the reason they choose not to go the open source route with the code was because it would be difficult to separate out the AG code from their own internal codebase and they didn't wish to leak any intellectual property etc... But now that officially AG/AGZ has finally retired, I don't see the reason as to why Google would not release the weights themselves. Not talking about training code even, just the final raw weights, or if they didn't want to give their crown jewel away, even intermediate weights or just the quality self-playing games etc... This I find puzzling.

So my current understanding is that MiniGo is lead by Andrew Jackson, an employee of Google, and while he has taken care to disclaimer the separation of the MiniGo project from the Deepmind team, it seems apparent to me that everything related to MiniGo project is being done on Google arch, including all the self-playing games hosted on Google storage (which requires a Google account to access) and I was also told that since they have refused the crowd distributed computing route of asking the public for help, that MiniGo will rely exclusively on Google's TPU cloud, aka Google will also provide the means of compute power for the project. Andrew Jackson stated on many occasions that his intent is for MiniGo to become a "top bot" (even if incidentally so) and I can also surmise that to mean a superhuman level bot stronger than any pro.

So to me, the 800 pound elephant in the room is why are we duplicating so much duplicated effort? We know Deepmind/Google already achieved great success with their zero method. I'm sure no one thinks Google didn't achieve their results fair and square, unlike things like cold fusion in a jar that was never able to be duplicated, I believe and I think we all believe Deepmind paper to be legit, I understand the scientific satisfaction of being able to nonetheless independently duplicate and verify the results and to produce the data etc etc...

We have on one hand Google /Deepmind who already first did the work, computed the weights, made a superhuman world class Go AI, but now we have multiple different Go AI projects (LZ, MiniGo, just to name a few) who wishes to each independently reproduce Google's work, to me it just seems like dual effort, since 1) we already know it can be done 2) what is the point of duplicating it twice and moreover, triply ironic is that MiniGo is basically Google trying to prove their work to themselves, I'm thinking is the right hand really not talking to the left hand?! Academically what is the point of independent reproduction and duplication /verification if it is essentially the same company recreating its own work? Sure Deepmind is under Alphabet and not Google, but that was just a reorg for tax benefits and its still one conglomerate. It would have been different if say hypothetically Andrew Jackson didn't host his stuff on Google storage, and didn't rely entirely on the good graces of Google's donation of 1000's TPU (very expensive something most people cannot afford!) to essentially provide the entire means of horsepower for his work... For all intents and purposes MiniGo is a Google project or otherwise heavily Google influenced and reliant. So to me, in my opinion, that obliterates the spirit of "independent reproduction" of the work from an academic basis...

My view and opinion on this all is that had Google released the weights to AGZ after its retirement, there would not be a community that would attempt to duplicate the results, or at the very least, much less people would have volunteered their computing cycles to any such project or similar initiative, etc.. of course that is just my speculation. But since two papers were published and Google withheld the release of code/weights/etc and AG basically went the way of DeepBlue after its retirement, its reasonable that there would arise a community to try to do exactly what Deepmind did with AGZ, maybe for academic curiosity but I think also because the Go community really wants a free zero bot that is at least pro level. But now comes a MiniGo, lead by a bona fide Google employee, and hosted on Google servers, and compute provided gratuitously entirely by Google themselves, with the intent to help it reproduce Google's own work, while LZ already exists and hit pro level first, .... so I'm confused, is it just me or what is the purpose of this convoluted round about? If Google wants the public to have access to a top level or superhuman level free Go AI they could have easily released AGZ to the public. If the intent is for Google to let someone else duplicate and recreate their work, they could also have stepped aside and let a project which was in spirit and essence totally unaffiliated with Google to create an academically independent results to prove to the world it works. Instead it seems like Google is content with offering their free cycles of Cloud TPU and donating it internally to their very own employee Andrew Jackson for him to use their hardware and their resources just in order to essentially recreate their own published work, aka weights that already exists and were precomputed at great costs by the exact very same company!... there is perhaps no better instance of the right hand purposefully not talking to the left... if they are going to donate to Andrew Jackson 1000's TPU they might as well just hand over the weights to him... talk about a duplication of duplicated effort! Really not sure what is going on here?!


r/cbaduk • • May 02 '18

Facebook open sources elf opengo

52 Upvotes

r/cbaduk • • Jul 06 '18

NEW APPROACH SUCCESS! Modification of LZ became very good at: playing (high) handicap games, playing non-slack style and playing with different komi.

47 Upvotes

Here is the github discussion, but let me try to summarize this new breakthrough:

What you can get

  • Handicap or even games with: 7.5 komi, 0 komi, -7.5 komi.

  • Games against bot that will not play slack moves during fuseki, middlegame or endgame.

  • Analyze old no-komi games from Shusaku and Go Seigen eras.

What you'll need

Examples

  • petgo3 games on KGS from 2018-07-06. Hasn't lost a single handicap game whole day (by the time of writing).

Future and wishful thinking

  • Maybe Chinese Tencent could modify their Fine Art (80-block?) to play handicap games against top pros and see how far it can go.


r/cbaduk • • May 21 '18

Neural-net-extracted Go problems from pro games

Thumbnail
self.baduk
46 Upvotes

r/cbaduk • • Jun 01 '18

Lizzie version 0.5 released!

Thumbnail self.baduk
42 Upvotes

r/cbaduk • • May 11 '18

Tencent open sources PhoenixGo (aka BensonDarr)

Thumbnail
github.com
42 Upvotes

r/cbaduk • • Jan 06 '19

Using Leela Zero to generate influence visualizations

41 Upvotes

How can we make use of strong Go bots to get better visualizations of influence? One obvious idea is to define "influence" as the expected end game state of each intersection, conditioned on the current board position. We can then approximate this with playouts from a strong Go bot. Here are some visualizations from my attempts to implement this idea using Leela Zero:

More diagrams here

How "influence" was computed

  1. For each board position, 100 playouts were generated with Leela Zero 40 block 196 weights using -v1 -m30 settings (1 visit, randomized first 30 moves)

  2. Each playout is no resign, and terminated when the winning player passed.

  3. End state is then evaluated using the area scoring algorithm in Leela Zero.

  4. Mean over the 100 playouts are taken to produce the output map.

Discussion

This concept of "influence" we adopted is more sensitive to shape and life/death, compared to influence based on flood fill. The first 3 diagrams compare 3-3 invasion variations, you can visually see how much "thinner" white's position is in the 3rd diagram.

We can also find the expected number of points by summing over any local area. For example, in the 1st diagram black expects to get 43.8 points in the lower left quadrant, compared to 43.6 in the 2nd diagram. Locally there is only a small difference of 0.2 points, however when summed over the entire board the advantage of the 1st diagram grows to 3 points (186.0 vs 183.0). My personal interpretation is that the increased strength of white's group in the lower left allows white to be more greedy globally, especially on the right side.

Some obvious limitations of this setup, 1 visit LZ is probably not strong enough to generate output useful for stronger players. Also, no resign settings + simple area scoring algorithm won't give us the most accurate end game states, but it looks like the problem mostly goes away averaging over 100 games.

There are also areas with "hallucinated influence" without any stones of that color. (e.g. at the star point corners) This reflects the AI's preference to play there in the future. We can make this go away by introducing more noise to the playouts, however at some point we start getting blobs that are less sensitive to good shape and life/death. Overall it's a trade off between diversity and strength of playouts.

Inspired by but not based on this project

Diagrams were rendered to SVG with code from this repo


r/cbaduk • • Mar 24 '18

Leela Zero 0.13 is out

Thumbnail
github.com
40 Upvotes

r/cbaduk • • Feb 19 '23

Man beats machine at Go in human victory over AI

Thumbnail
arstechnica.com
39 Upvotes

r/cbaduk • • Jan 07 '18

Leela Zero 0.10 + AutoGTP v11

Thumbnail
github.com
39 Upvotes

r/cbaduk • • Nov 20 '17

Leela Zero links and status

38 Upvotes

r/cbaduk • • Jun 18 '19

New KataGo run - around ELFv2 strength, and other developments

37 Upvotes

I've just updated KataGo with a new release featuring a fresh run that after 19 days of training (using a max of 28 GPUs at any given time and on average somewhat less than that) should be near or even slightly past LZ-ELFv2 strength at visit-parity according to some tests! This is with a 20 block, 256 channel net. The full neural net history and training data and sgf games from this run are also available for download. Reaching this strength and level of value sharpness also does not appear to have weakened its ability to play reasonable handicap games either.

In other news, while for the most part compiling and running KataGo still requires CUDA, I've begun work on an OpenCL branch. Although I have not tested it extensively, currently it should actually be functional! It will however be very slow since most of the kernels are using reference implementations and are completely unoptimized right now, so I don't recommend it for actual use quite yet. I plan to work on it in the coming weeks on the days when I can get some more spare time.

And since the last release, KataGo has now implemented the "lz-analyze" GTP extension, which means that once compiled and working (CUDA still recommended, for now), it should plug into any other analysis tools that rely on lz-analyze. Additionally, for interested developers, there is a "kata-analyze" command that works exactly the same except that it also reports the estimated score and can report the whole-board territory ownership heatmap. Watching some high handicap games on OGS (https://online-go.com/player/592684/) I've been finding the estimated score very useful to have alongside the winrate, as it makes it much clearer to see major early mistakes even when those mistakes barely budge the winrate because objectively black is still well ahead. If there's any tool that wants to try adding support, happy to help and answer questions!


r/cbaduk • • Jun 13 '18

MiniGo: TensorFlow Meets Andrew Jackson

Thumbnail
youtube.com
37 Upvotes

r/cbaduk • • Dec 06 '17

[1712.01815] Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm

Thumbnail
arxiv.org
37 Upvotes

r/cbaduk • • Apr 26 '18

Leela Zero is officially looking for strong professional opponents, spread the word

36 Upvotes

There was a suggestion on Github to celebrate 7 million self-play games by crowd funding a match or matches against strong professionals.

GCP just made a post in the thread with the suggested conditions and how to contact him if you are a professional with a 7-dan rank or higher.

This is quite cool, since it would be the first time that the official project would be playing. No unofficial nets, or operators playing weird moves that Leela Zero wouldn't play etc.

I'm posting this here with GCPs message and link in case someone here knows Chinese, Japanese or Koreans pros who might be interested.

https://github.com/gcp/leela-zero/issues/1261#issuecomment-384589582

Here's GCPs message in the thread copy pasted:

  • Best of 5 match.

  • 7.5 komi, no handicap, Chinese rules.

  • 45 minutes main time, 5 x 30 second byo yomi periods.

  • Played online on OGS or KGS.

  • Time and dates to be agreed.

  • Opponent should have a 7th dan professional rating or higher.

Leela Zero will use the public software, the latest official network, hardware that is available to any member of the public, and run fully automated. The operator may resign on behalf of Leela.

If a professional is willing to play Leela Zero under these conditions, they can contact me at [email protected] with a proposal and the fee they'd require.


r/cbaduk • • Dec 13 '17

We're at 1M!

Post image
36 Upvotes

r/cbaduk • • Apr 07 '18

Little bit of rules

35 Upvotes

We don't have any kind "official rules" here, but please (a) be polite (b) don't start and don't continue flaming wars; otherwise you may end as a certain user I was forced to ban from /r/cbaduk

I'm very sad that I have to post this announcement.

Update: zero-tolerance for spam.


r/cbaduk • • Dec 04 '17

Leela Zero (585k network) beats beginerbot. Twice.

35 Upvotes

Beginerbot is a 24k bot on kgs. It's about human beginer level.

Here is the first game. It was extremely close. At one point in the game, LZ was in a desperate position, but she made a great comeback, showing superior end game skills, and finally getting a 1.5 win: http://eidogo.com/#1JZW1EyhK

Here is the second one. This time LZ was never really far behind: http://eidogo.com/#3DxDSf0wB

My testing account for Leela Zero is now 24k on kgs. It was 10 seconds/move on my computer, which makes about 1500-2000 playouts/move. So not a lot. More powerful computers running LZ can probably crush beginerbot easily.

Edit: I played two more games, but this time LZ was white.

In the first game (http://eidogo.com/#22tMwfY), she got trashed pretty badly.

In the second game, I was suggested to use the additional command line option "-t 1" to narrow the search. LZ won this one convincingly: http://eidogo.com/#y75gDO6t

It's just one game, so not sure how the "-t 1" affects LZ's strength as white. Just reporting what I got.

Edit 2: Played with weakbot50k[22k] 3 times. LZ won surprisingly easily as black, and got destroyed as white. Then she lost an eventful game as black. This bot has a style completely different from beginerbot. Weakbot is superior in fights, but waste many moves doing absolutely nothing.

I'm editing here instead of creating another post. I think I'll do one post like this listing kgs game results for each new version of LZ.


r/cbaduk • • Mar 19 '18

LeelaZero hits 9d on OGS for the first time

Post image
34 Upvotes

r/cbaduk • • Dec 30 '17

1 day, 1451 games, 7kWh, $0.50

Thumbnail
imgur.com
34 Upvotes

r/cbaduk • • Nov 24 '17

265k Network is out and tops 137k

34 Upvotes

autogtp just pulled the 265k network for me and according to this post it's beating 137k pretty handily. Looking forward to seeing some games from it.


r/cbaduk • • Jul 16 '18

LZ#155 to #156 Ten Game Matches Report

33 Upvotes

As a reminder:
In these games, LeelaZero’s Time Management is turned off. That means that she’ll run the desired amount of visits, plus a couple of extras due to slow brake...

In the last episode, LZ#154 scored 3 wins/7 losses against an unbridled Leela11, using ONLY 40 visits: XXXXO with White, XXOOX with Black

Two networks got promoted since last report.
Let’s see what they can do.

LZ#155 with 40 visits vs Unlimited Leela11:
Outcome: 6 wins/4 losses (1 Ladder)
Results taking White: OOOXX
Game 01: O http://eidogo.com/#k9Awg2ct
Game 02: O http://eidogo.com/#4lkbhU621
Game 03: O http://eidogo.com/#2pBCI0fCH
Game 04: X http://eidogo.com/#3TsvUhYNJ
Game 05: X http://eidogo.com/#Bho63vQU
Results taking Black: OOXXO
Game 06: O http://eidogo.com/#3MOnL92L2
Game 07: O http://eidogo.com/#lkNBYgVz
Game 08: X http://eidogo.com/#FmxJRTAK (Ladder)
Game 09: X http://eidogo.com/#16ADPxn18
Game 10: O http://eidogo.com/#4fv97ZHlR

Aha!
Knowing theoretically that networks are improving is one thing, but seeing positive results with fewer and fewer visits is something else :)
I mean, we still have a long way to go, but I have no doubt that we’ll reach the 1 visit threshold eventually...
By the way! While I’m writing these lines, a 400-Game Test Match against LeelaElf is ongoing, and LeelaZero seems to be doing a lot better than last time… for now anyway.

LZ#155 with 35 visits vs Unlimited Leela11:
Outcome: 3 wins/7 losses (2 Ladders)
Results taking White: XOXXO
Results taking Black: XOXXX

That was to be expected.
Now, let’s see the next network.

LZ#156 with 35 visits vs Unlimited Leela11:
Outcome: 4 wins/6 losses (3 Ladders)
Results taking White: XOOXO
Results taking Black: XOXXX

Not too bad. Maybe a couple of promotions will be enough already to deal with 35 visits only...

On the other hand, LZ#156 is already plenty strong. I wonder if she could do better than LZ#153 at Handicap games…
Don’t worry, I’m not gonna throw countless game results at you again :p
I’ll stick to 9 stones handicap Go.
Just remember that for large handicaps, you better use Alreadydone’s special engine over there:
https://github.com/alreadydone/lz/releases/tag/komi-v0.3

In the last episode, Handicap-LZ#153 (taking White with komi) scored 2 losses (XX) against Normal LZ#60 (taking Black with 9 Handicap Stones).

As a reminder, I ran the games with time parity, which resulted in about 300 playouts per move on average for LZ#156, but way WAY more for her opponents, given that they were 6-block networks. I used commands -r 0 and -d for White in order to prevent premature resignations, and -r 10 for Black. As a result, the games often ended in a series of inside territory moves to get rid of remaining dead stones...

(White, with komi) Handicap-LZ#156 against Normal LZ#60 (Black, with 9 Handicap Stones):
Game 1: X http://eidogo.com/#16IX8ET7V
Game 2: O http://eidogo.com/#4vTIwOU4B
Game 3: O http://eidogo.com/#GLwR2IWN

Wow! I know Three-game Matches aren’t enough to make a serious judgement, but still: last week, I had to lower the handicap to 7 stones for LZ#153 to finally beat LZ#60…
But LZ#156 could do it even with 9 stones! :)
Oh, and did you see how LZ#156 started the game? XD
Attach and cross-cut, then bully the weak like you own the board :p
I wonder if that’ll work against LZ#65 too…

(White, with komi) Handicap-LZ#156 against Normal LZ#65 (Black, with 9 Handicap Stones):
XOX

Not quite, although she managed to score a win :)

Now, what about the Master sisters? Did they improve too? As a reminder, here’s their lair:
https://github.com/pangafu/LeelaMasterWeight

In the last episode, LM15b-GX31 scored 4 wins/6 losses against an unbridled Leela11, using ONLY 60 visits: XXXXX with White, OOOXO with Black.

LM15b-GX37 with 60 visits vs Unlimited Leela11:
Outcome: 3 wins/7 losses (1 Broken Ladder)
Results taking White: XOXXX
Results taking Black: XOOXX

Mmm...

LM15b-GX39 with 60 visits vs Unlimited Leela11:
Outcome: 6 wins/4 losses (1 Broken Ladder)
Results taking White: XXXOO
Game 01: X http://eidogo.com/#yLspMKAp (Broken Ladder)
Game 02: X http://eidogo.com/#7iWuIndT
Game 03: X http://eidogo.com/#CKA30OOe
Game 04: O http://eidogo.com/#2XieYpH3j
Game 05: O http://eidogo.com/#rqzl8uNU
Results taking Black: OOOXO
Game 06: O http://eidogo.com/#3Y04znNVc
Game 07: O http://eidogo.com/#xVxK9Cwp
Game 08: O http://eidogo.com/#rsHNRobK
Game 09: X http://eidogo.com/#H7kHMtrh
Game 10: O http://eidogo.com/#49IHA1L5n

Ha! Progress again!

LM15b-GX39 with 55 visits vs Unlimited Leela11:
Outcome: 3 wins/7 losses (2 Broken Ladders)
Results taking White: XOXOX
Results taking Black: XXXXO

By the way, on LeelaMaster’s GitHub page, Pangafu announced that he will work on another human style AI, using different methods. The new creature will be called Octopus and will be open-source too.
I’m looking forward to it :)

To conclude this report, I’d say we had a really good week, with steady progress on three levels: Zero, Master and Handicap.
The future is bright :)

Anyhow, you can spread the word: 35 visits is our new boundary.

Until next time.


r/cbaduk • • Apr 23 '18

Lizzie (Leela Zero Interface) 0.4 is released

Thumbnail
self.baduk
33 Upvotes