sql - Querying a database - Webservice only access -


we attempting run queries on database (27,000 records) ask questions such :

  • show example of particular table / section being used
  • show examples meet criteria
  • some examples of particular field

we have xml access via webservices data. webservices provide filtering functions basic , geared around sort of faceted search.

i can think of 3 major ways achieve (of course there many more - ones i'm considering) :

  1. write perl/python script pull data , stick somewhere
  2. use kind of etl tool import data , map database
  3. write kind of script can search data "live" using webservices available

i think 3. out - webservices don't provide enough functionality.

is there automated awesome tools can convert xml sql in form vaguely usable , searchable? how go solving problem?

prefer linux/open-source environment solution , ideally way achieve fast , free rather expensive tool.

27k rows isn't large database imo - unless rows excessively large (e.g. unless each row deep entity graph), pulling rows web service memory , caching them there seems approach - might @ re-storing data in sql (e.g. xml field) or in nosql database mongodb (although should reserialize data json/bson out of mongo).

you need implement mechanism detect changes on live underlying data in order refresh cached data.

when bulk-pulling data source webservices, because xml such verbose protocol on wire, may need break data web services chunks avoid timeouts or other issues.

re : tools querying xml xquery allow perform arbitrary searches on xml data, , in .net have tools linq2xml. also, if can load data single xml stream / document, able use xpath query it.


Comments

Post a Comment

Popular posts from this blog

.htaccess - First slash is removed after domain when entering a webpage in the browser -

sometimes when hit address of webpage in browser, removes first slash after domain. examples: www.mywebsite.com/scripts/script_6.php -> trying load www.mywebsite.comscripts/script_6.php www.mywebsite.com/test.php -> trying load www.mywebsite.comtest.php after entering again, loads page. a .htaccess settings must wrong: rewritebase / errordocument 404 http://www.mywebsite.com/oops.php errordocument 401 /notallowed.php rewriteengine on # turn on rewriting engine #gzip <ifmodule mod_deflate.c> addoutputfilterbytype deflate text/text text/html text/plain text/xml text/css application/x- javascript application/javascript </ifmodule> #end gzip rewritecond %{http_host} ^mywebsite\.com rewriterule ^(.*)$ http://www.mywebsite.com$1 [r=permanent,l] directoryindex index6.php rewriterule ^termsofuse/?$ termsofuse.php [nc,l] # handle requests "adpolicy" rewriterule ^privacy-policy/?$ privacy-policy.php [nc,l] # handle requ...
Read more

Automatically create pages in phpfox -

i have array of information of places , wanna use them create multiple pages in phpfox site. first tried manually insert data in phpfox database (in tables of phpfox_pages , phpfox_pages_text ). the page shown in site when opening it's link, site says: the page looking cannot found. do know other tables should manipulate make work? or know plugin phpfox same? thanks, solved ( @purefan guide): "pages" has user if take @ phpfox_user table, you'll found out how fetch new records on that. there 2 ambiguous fields in table ( password & password_salt ). can use script create values fields: <?php function generaterandomstring() { $length = 164; $characters = '-_0123456789abcdefghijklmnopqrstuvwxyzabcdefghijklmnopqrstuvwxyz'; $randomstring = ''; ($i = 0; $i < $length; $i++) { $randomstring .= $characters[rand(0, strlen($characters) - 1)]; } return $randomstring; } $ssalt = '';...
Read more

c# - Farseer ContactListener is not working -

i'm using farseer in xna project, have trouble contactlistener. created class contactlistener these 2 error messages , don't know how fix problems. the type or namespace name 'contactlistener' not found (are missing using directive or assembly reference?) the type or namespace name 'contactimpulse' not found (are missing using directive or assembly reference?) what wrong contactlistener class? class mycontactlistener: contactlistener { void begincontact(contact contact) { /* handle begin event */ } void endcontact(contact contact) { /* handle end event */ } void presolve(contact contact, ref manifold oldmanifold) { fixture fixturea = contact.fixturea; fixture fixtureb = contact.fixtureb; if (fixtureb.collisioncategories == category.cat10) { contact.enabled = false; } } void postsolve(contact contact, ref contactimpulse impulse) { /* handle post-solve event */ } }...
Read more