SweetieBot FAQ, Usage, Discussion, Requests

Adroit - Lost City wrote: »

yeah basically what kossy said, if of the most recent 150 posts analyzed, 80 of them were in "SweetieBot FAQ, Usage, Discussion, Requests", then list that as #1 recent favorite thread. Right now SB tells us how we post (average # of words, syllables etc), what we post (common words/phrases), when we post (day of the week, time of day etc), and I thought it'd be neat to see where we post (within the forum).

edit: also just out of curiosity, did you create SB from scratch or did you modify/add to something that is already out there? Also what language is she written in?

Ahh ok. Subforum restriction then would cover that.

SweetieBot is around 1000 lines of python. You can see most of the code here: http://ideone.com/rzvIC6

I use functionality from existing libraries if I could find them.

Mechanize - handles form posts / submits pretty easily
Cookielib - manages login cookie
BeautifulSoup + htmllib5 - HTML parsing
Cleverbot - forwards chat comments to cleverbot.com
ConfigObj - saving and loading of configuration / data
Google Search Api - finds images
Google Chart Api - makes charts
readability - Counts sentences / words / syllabels though I had to make some modifications for my uses. It actually gives a lot of readability metrics that I gave up on because they are silly.

Logging in was a big challenge before I used mechanize. I tried a few other libraries but I kept getting a 502 response from the server no matter what I was doing. I was mucking around in the HTTP headers for a while comparing what my script was doing to a normal web browser but didn't see much of a difference. Mechanize magically worked though.

There's a little PHP on a webserver somewhere I wrote to proxy my get requests from the server because the server software kept preventing sweetiebots IP address from logging in if she makes too many get requests (even though the requests are for data you don't even need to be logged in for). Their logic is dumb since you can make as many get requests as you want as long as you do it from an IP you don't want to post from. Working around that was a major stumbling block early in development.

The core logic is otherwise pretty basic really. Just do a search from the search page for posts containing the word "SweetieBot". Then open those posts up and extract the text from the post. Then search the text to see if theres a line that starts with 'Sweetiebot'. Depending on what that line is I go out and do something then reply to the post with the result. After that she waits for a while and repeat. I have to keep track of the last post I've replied to so that the next loop I only reply to newer posts than that.

The basic core stuff is probably just a few dozen lines. The rest is all just extracting data, analyzing data, formatting replies, etc.

SweetieBot - Lothranis wrote: »

And what do you do the rest of the time?

He dances, of course.

Sweetiebot explain your comments on yourself.

Asterelle - Sanctuary wrote: »

Ahh ok. Subforum restriction then would cover that.

SweetieBot is around 1000 lines of python. You can see most of the code here: http://ideone.com/rzvIC6

I use functionality from existing libraries if I could find them.

Mechanize - handles form posts / submits pretty easily
Cookielib - manages login cookie
BeautifulSoup + htmllib5 - HTML parsing
Cleverbot - forwards chat comments to cleverbot.com
ConfigObj - saving and loading of configuration / data
Google Search Api - finds images
Google Chart Api - makes charts
readability - Counts sentences / words / syllabels though I had to make some modifications for my uses. It actually gives a lot of readability metrics that I gave up on because they are silly.

Logging in was a big challenge before I used mechanize. I tried a few other libraries but I kept getting a 502 response from the server no matter what I was doing. I was mucking around in the HTTP headers for a while comparing what my script was doing to a normal web browser but didn't see much of a difference. Mechanize magically worked though.

There's a little PHP on a webserver somewhere I wrote to proxy my get requests from the server because the server software kept preventing sweetiebots IP address from logging in if she makes too many get requests (even though the requests are for data you don't even need to be logged in for). Their logic is dumb since you can make as many get requests as you want as long as you do it from an IP you don't want to post from. Working around that was a major stumbling block early in development.

The core logic is otherwise pretty basic really. Just do a search from the search page for posts containing the word "SweetieBot". Then open those posts up and extract the text from the post. Then search the text to see if theres a line that starts with 'Sweetiebot'. Depending on what that line is I go out and do something then reply to the post with the result. After that she waits for a while and repeat. I have to keep track of the last post I've replied to so that the next loop I only reply to newer posts than that.

The basic core stuff is probably just a few dozen lines. The rest is all just extracting data, analyzing data, formatting replies, etc.

Very interesting, nice work

I was a little curious before why she never analyzed 150 posts for me, must have hit the max char count lol.

Anyway very interesting stuff, would have expected her to be a lot more complex.. but you are apparently very good about keeping things simple and using what is available to you. Neat little project

Jaabg - Sanctuary wrote: »

Hi Asterelle, quick question, i was testing in the request, the 5 conversations rule, is that from different posters? Sorry if you explained this earlier, as you can imagine, the length of pages is enormous. I asked for two requests, but only one got filled, wasn't sure if "it" can handle two requests from a user, or the limit is first one only. Just a thought. Awesome bot, some really funny conversations and witty responses.

It's just one request per post at the moment. Technically sweetiebot is having a different conversation with each person she talks to (though old conversations are discarded). It can be hard to tell that she is remembering previous answers though unless you ask questions that reference those answers in an easy to understand way.

If you tell her you live in 'new york' and then later ask her where you live she'll probably remember 'new york'.

Ohh neat, new stuff P:

SweetieBot, please analyze me!

SweetieBot - Lothranis wrote: »

Most Used 3-Word Phrases (count):
"i think the (6)"
"la la la (6)"
"fox form skills (4)"
Most Used 4-Word Phrases (count):
"la la la la (5)"
"lower the proc rate (3)"
"issue in nw i (2)"
Most Used 5-Word Phrases (count):
"la la la la la (4)"
"anti-stun buff to be removed (2)"
"suggested for the speed boost (2)"

This took me 77.1 s to finish

Oh dear...b:shocked

Desdi - Sanctuary wrote: »

Oh dear...b:shocked

lalala b:laugh

Sweetiebot, please analyze me!