Georgie Casey

I’ve booked loads of Ryanair flights and every time they ask you for your name, address, mobile and when you check in online, they ask for your passport number and date of birth. Why do you have to do this everytime? Why can’t you register an account on the ryanair website and have all this information stored for you so you can book flights with one click. It would make life easier for customers and provid loads more potential cash for Ryanair.

They could start a self-serve ad system like Facebook’s and let advertisers target customers by nationality, destination and age. Right now they just have generic Hertz ads when you book your flight which I doubt bring in much conversions. How much would a small car hire firm in Knock make if they could target all German people over the age of 40 with a German language ad right after they’ve booked their flight to Knock? And they more targeted and higher converting ads, the more money for Ryanair. And this is guaranteed correct info, nobody is going to put a fake nationality or date of birth on their online check in.

Of course all this data gathering would need a pretty good terms and conditions but I sure that could be drawn up easy. Ryanair are leaving so much €€€ on the table, there IT department must be retarded.

As I said in my last post, I’ve written many a scraper using php with curl or fsockopen in my time, trying to write automated tools and scraping data. I’ve tried many tools to help me sniff the HTTP traffic so I could emulate it in PHP as quick as possible. I started off using Wireshark or Ethereal as it was called at the time which was complete overkill, mostly used for network trouble shooting and grabs all TCP/UDP packets which is information overload, all we want is HTTP data. Then I think I used the LiveHTTPheaders addon for Firefox which was pretty limited. Then a Java program called Burpsuite which was pretty powerful but I ran into a problem trying to automate myspace myads submissions, trying to figure out what HTTP the myads flash file was sending over HTTPS. I ran the gamut of every proxy tool out there until I came across Charles Web Proxy.

It’s basically the best out there. It sits as a proxy between the web and your browser, grabbing all data as it comes in. This usually causes problems with SSL but it has a custom SSL cert that you manually add to your browser that lets you log HTTPS data with no warnings. It can grab Flash traffic as it seems to work as a Windows proxy, not just a browser one. It presents HTTP data many different ways so you can understand what’s going on quicker. For example, a multipart form upload is presented as the the raw HTTP data sent, just the headers, just the cookies, the text body and all the form fields. I won’t list all the features as they’re all listed on the site. If you’re using any other tool for automation/scraping, you’re wasting time.

In my many of years of php/curl use, I’ve hammered my head off my table countless times trying to debug scripts that weren’t emulating the browser like it was supposed to. This was pretty hard without seeing the exact HTTP request header sent by cURL each session, but this is possible now from PHP 5.1.3

Use the curl_getinfo php function with the CURLINFO_HEADER_OUT option but make sure to set option CURLINFO_HEADER_OUT to true as a curl option.

$ch = curl_init("http://www.google.com");
curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1);
curl_setopt($ch, CURLINFO_HEADER_OUT, true);
$get = curl_exec($ch);
$info=curl_getinfo($ch,CURLINFO_HEADER_OUT);
var_dump($info);

This is more for my own reference than anything. Say you see a flog on the intertubes and want to rip it and stick up for affiliate links. How to do it quickly on Linux? I used to use wget but it sucked. httrack is much better.

httrack "http://www.techcrunh.com/" -N1 -O "/home/techcrunch_rip/public_html" +techcrunch.com/* +crunchgear.com/* -v

This will rip the homepage of techcrunch and stick it in the folder specified by -O. URL filters next ensure it only downloads files from certain domains. The -N1 argument is the most important, it ensures htttrack sticks all images, css in one directory instead of creating loads of directories. Very handy.

I was looking for an iPhone app a while ago to search Irish business phonenumbers and couldn’t find one, so wrote one myself. And while I was waiting for Apple to approve my app, a different phonebook app was released with better user interface! BUT it just searches the goldenpages website so you need a net connection. I scraped the Goldenpages website and stuck it in the app, so no net connectio needed, handy when you quickly need a number.

Check it out here, only e2.39 to buy

Diggbar just release which is a URL shortening service as well with full, do-follow links. Wonder how long it lasts.

Sick of waiting for the facebook ads API? Download my PHP one today. Features include:

• Create ads from PHP script loop. You can modify any paramaters you want and submit 100s of ads an hour but that will prob get your account banned
• Pull info from your DB to submit ads. eg You could pull artist names and submit loads of ringtone ads using each individual artist
• I provide a mysql table of all US cities you can target with Facebook, along with the user count for each city. So you can loop through all these and create targetted ads to every city in the US. eg ‘Meet Atlanta, GA Women’ today targetted at just Atlanta, GA demo. This is sure to improve CTR and lower your CPC.
• Support for proxies

This is the code you use to create ads. #!/usr/local/bin/php
// Put your mysql details in the follwing line
$mysql= new mysqli("localhost","username","password","db");
include("facebook.php");
$facebook = new Facebook();
$facebook->setLogin(”yourfacebookemail”,”yourfbpassword”);
$facebook->getHomeCookie();
$facebook->signIn();
$facebook->getAdsHome();
$facebook->locationtype=”city”;
// The script doesn’t support creating campaings yet so you need to get this from ads Manager. On the create an ad page, the select box at the bottom where you pick your campaign, just go into the HTML source and find the value for the campaign you want to use.
$facebook->campaignid=”campaignid”;
// Not sure if these 2 values make a difference. No harm in setting them right.
$facebook->campaignbudget=”500.00″;
$facebook->dailybudget=”500.00″;

$query1=$mysql->query(”SELECT * FROM us_cities WHERE done=’no’ ORDER BY usercount DESC”);
while ($result1=$query1->fetch_assoc()) {
$insertid=$result1[”id”];
$fbid=$result1[”facebook_id”];
$city=$result1[”city”];
preg_match(”/(.+?), .+?/”,$city,$justcity);
// this uploads image used in ad.
$facebook->uploadFacebookImage(”image.jpg”);
// this actually creates and approves the ad. works like this createAd(ad name in ad manager, ad url without the http://, ad title (keep less than 25), ad body (keep less than 135), country, min age, max age, cpc bid, city id, gender targeted, education targeted) $JUSTCITY[1] has the name of just the city like Atlanta, $city has the state as well eg Atlanta, GA
$facebook->createAd($city,”www.yoururl.com/index.html?id={$insertid}”,”{$justcity[1]} Free Grants”,”Our records show 100s of unclaimed grants issued by Pres. Obama available to {$city} residents. You need to claim now.”,”US”,”21″,”25″,”0.39″,$fbid,”male”,”all”);
$query2=$mysql->query(”UPDATE us_cities SET done=’yes’ WHERE id=’{$insertid}’ LIMIT 1″);
// this is the value of seconds waited before submitting each ad. suggest keep it at 15 unless you want your account banned
sleep(15);
}
?>


Here’s a screenshot of the facebook cities table:

Price is $200. If you want a copy, paypal the cash to filmfind@eircom.net and I’ll email you a copy within a few hours.

Said I may as well attend one of these conferences and try to ‘network’ a bit in the ‘aul Internet marketing world. Or it could be just an excuse for tax deductible trip to Vegas The conference is on January 11th (Sunday) to January 13th (Tuesday) but I’m flying in the previous Friday, check out Vegas for the weekend. Staying at the conference hotel, the Rio which is off the strip. Anyone else going and want to meet up, shoot me an email georgiecasey at gmail dot the com or twitter

I’m not a fan of most Apple stuff, they’re overpriced and the hardware they use is cheap. They do make sexy looking stuff though, I’ll give em that. And they seem to get away with anything and still have their fanboy faggots drooling over them (I’ve experienced this species IRL in their herds at the diggnation filming in London).

Fan of the iPod and iPhone though. Not a fan of iTunes and Quicktime, which are required to update firmware on these two products. Quicktime is possible the worst piece of software I’ve ever used. It fecked up Youtube’s sound on firefox when it installed (with iTunes, which I need) by trying to play all video and sound files. So I went into settings and unchecked them.

Then I needed to update firmware on my Iphone to 2.1, which required an upgrade of iTunes, which required an upgrade to Quicktime, which changed back all my settings without asking and fecked up Firefox again. If Microsoft did this the bloggers would have a field day.

Was browsing forums on some private bittorrent sites lately and noticed that a tracker and website dedicated to Irish TV torrents has cropped up, about time too. The Brits, Yanks and Antipodeans all have one for their TV, why should we miss out! Site pretty bare with content right now but it should flesh out.