hi Ryan

would you be interested in joining my session at badcamp 2013 and co-hosting perhaps with me and one or two others working in this area ?

http://2013.badcamp.net/sessions/big-data-drupal-cloudera-hadoop-mapredu...

perhaps we could have 10 minute lightening talks and then more of an interactive discussion with audience?

cheers

-N

Comments

forestmars’s picture

forestmars commented
Component: Code » Miscellaneous
rszrama’s picture

rszrama commented

Wow, dude, looked through your slides and think I need to be sitting in the room more than on the stage. Can't wait to see it! Do you expect to have a hypermedia / REST API focus in the content that isn't shown in the slides? I'm happy to contribute if so but am also happy just to show up and learn. : )

niccolox’s picture

niccolox commented

on d.o, no-one can hear you scream "heeeeeeeeeeeeeeeeeeeeeeelp", bit nervous, my project is a grassroots effort, and I am worried people will come thinking I am somekind of big iron drupal guru... anyway.

one area / direction I am going to try to look at before the talk is make a module, perhaps a Search API module, maybe D8 Search API (or something else) that talks to the HBASE Rest API via Stargate or Thrift

I'd like to be able create content types or entities in Drupal based on Hbase columns (tables), Remote Entity API is another possibility

I think its going to be a pretty thin working demo and a bunch of ideas about R&D areas and directions

seriously, I'd be interested in your take on HBASE integration via REST API
https://blog.cloudera.com/blog/2013/03/how-to-use-the-apache-hbase-rest-...

I doubt I'll be able to any development on HBASE / REST before the event - I own a farm and need to prepare the fields for the rains which are coming - and the best I can do is research, maybe some basic POC's based on existing code / tools

perhaps you have some time later next week to discuss? I am in Sonoma County and could go to the Peninsulia

niccolox’s picture

niccolox commented

I've sent an email to the Cloudera users group, fishing for Cloudera talent who can answer any questions about the underlying zoo of Apache Foundation big data products and services...

https://groups.google.com/a/cloudera.org/forum/#!topic/cdh-user/Uwuj1q7bWBY

mitchell’s picture

mitchell commented

Spoke with niccolo (thanks, Forest), and I'll leave the couple of the projects mentioned here.

For integrating NoSQL, big datasets: Mongo Entity.

For integrating REST resources as remote entities: Salsa Entity + Salsa API.

(Salsa.. would need to be re-hard-coded for the specific API; though, at one point, I tried to make progress with fmizzell on swappable entity storage backends for ECK entity types and a reusable XML driver for reconfigurable XPath queries, but that's not going on anymore. Also worth looking into is replacing the web requests processing / connection manager with Guzzle so that multiple, non-blocking queries could take place at once.)

niccolox’s picture

niccolox commented
Status: Active » Closed (fixed)

I am closing this request for clarity

I have gotten over my stage fright (this weeks anyway) and will just suck it up and fly solo

Cheer's and good luck

rszrama’s picture

rszrama commented

Ok, great. I'll look to attend the presentation in SF, and I'd love to hear about the farm. : )

niccolox’s picture

niccolox commented

I am actually attending the Commerce training, so I may see you in person

in the meantime I wrote a vague howto http://www.bigdatadrupal.com/howto-big-data-drupal-search

and also some future directions speculation http://www.bigdatadrupal.com/content/future-directions

I'll try to do something with D8 and/or Search API Wed

cheers