Jump to content

Tensorflow training on Wikipedia articles

I'm not sure whether this is the place to post this....but here it goes:

 

Would it be possible to train a tensorflow network on wikipedia articles (a bit like Watson)? If so, how would I do this?

Link to comment
Share on other sites

Link to post
Share on other sites

Train it to do what exactly? I believe there is an API you can use to scrape things from Wikipedia. However you would need to annotate it probably.

PSU tier list // Motherboard tier list // Community Standards 

My System:

Spoiler

AMD Ryzen 5 3600, Gigabyte RTX 3060TI Gaming OC ProFractal Design Meshify C TG, 2x8GB G.Skill Ripjaws V 3200MHz, MSI B450 Gaming Plus MaxSamsung 850 EVO 512GB, 2TB WD BlueCorsair RM850x, LG 27GL83A-B

Link to comment
Share on other sites

Link to post
Share on other sites

I would like to train it to answer questions I give it: e.g Who is the President of the US?

Link to comment
Share on other sites

Link to post
Share on other sites

13 hours ago, MarkJFannon said:

I would like to train it to answer questions I give it: e.g Who is the President of the US?

semantic understanding of questions seems like it'd be VERY hard. My guess is that if you are trying to make your own AI (aka you're not going to just use an existing trained API) then training a model to correctly understand semantic commands and queries is going to be the harder part of this problem.

 

EDIT: I just realized that you are using tensorflow, which is an existing API. I have no idea what is involved with this project then, and would delete this if i could. sorry :D

Gaming build:

CPU: i7-7700k (5.0ghz, 1.312v)

GPU(s): Asus Strix 1080ti OC (~2063mhz)

Memory: 32GB (4x8) DDR4 G.Skill TridentZ RGB 3000mhz

Motherboard: Asus Prime z270-AR

PSU: Seasonic Prime Titanium 850W

Cooler: Custom water loop (420mm rad + 360mm rad)

Case: Be quiet! Dark base pro 900 (silver)
Primary storage: Samsung 960 evo m.2 SSD (500gb)

Secondary storage: Samsung 850 evo SSD (250gb)

 

Server build:

OS: Ubuntu server 16.04 LTS (though will probably upgrade to 17.04 for better ryzen support)

CPU: Ryzen R7 1700x

Memory: Ballistix Sport LT 16GB

Motherboard: Asrock B350 m4 pro

PSU: Corsair CX550M

Cooler: Cooler master hyper 212 evo

Storage: 2TB WD Red x1, 128gb OCZ SSD for OS

Case: HAF 932 adv

 

Link to comment
Share on other sites

Link to post
Share on other sites

Not exactly sure how TensorFlow works exactly, you'd need to learn natural language processing as well if it will be answering questions.

Link to comment
Share on other sites

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×