Difference between revisions of "Wiki report"

From Freephile Wiki
Jump to navigation Jump to search
(10 intermediate revisions by the same user not shown)
Line 1: Line 1:
__NOEDITSECTION__ __NOTOC__
 
 
Find out "What's that Wiki Running?" at https://freephile.org/wikireport
 
Find out "What's that Wiki Running?" at https://freephile.org/wikireport
  
  
== APIs in action ==
+
== Background ==
This project is about two [[API]]s.  Using them, and having them work together. We're using the MediaWiki API, and and the CiviCRM API.
 
  
== MediaWiki ==
+
The MediaWiki <abbr title="Application Programming Interface">[[API]]</abbr> offers great detail into what a [[MediaWiki]] wiki is running.
  
We're using the [[MediaWiki]] API for a couple different purposes.
+
The ApiSandbox extension offers a GUI way to explore and even operate on the API <ref>[https://git.wikimedia.org/blob/mediawiki%2Fextensions%2FApiSandbox/c69d2923bd5ff5424ce89a12b87f02708c80d487/SpecialApiSandbox.php code]</ref>
Most obviously we're using the API, which is available in every MediaWiki installation, to query that installation's exact setup, statistics and extensions. Secondly, '''this page''' is using the MediaWiki API to re-use content. Or, put another way, we wrote content in a wiki backend, and we're using that content on a different 'frontend' website. We're showing an example of using MediaWiki as a back-end content editing platform, while the '''Wiki Report''' project publishes that content with 5 simple lines of code on a completely different website.  Through the API, you could re-use any MediaWiki content on any other project or platform.  So, if you have a wiki, and you have content there that you think should be somewhere else: don't copy it!  Re-use it via API!
 
  
== CiviCRM ==
+
The most popular data format for API communication is <abbr title="JavaScript Object Notation">[http://www.json.org/ JSON]</abbr>.
  
The free '''Wiki Report''' generates a lot of data about wikis across the Internet. We collect and/or report on this data by storing it in a CiviCRM database. [[CiviCRM]] is a fantastic freely-licensed Constituent Relationship Management system.
+
[https://php.net/manual/en/intro.json.php PHP handles JSON] consistent with the expanded definition of "JSON text" in the newer [http://www.faqs.org/rfcs/rfc7159.html RFC 7159].
  
== Bootstrap ==
+
What I need to do is collect data, based on some data that I have in a CiviCRM comment (and the original csv file that was imported to CiviCRM), and re-import or add the new data to CiviCRM for market segmentation and intelligence.
  
We're using [[Bootstrap]] for building a nice HTML5, responsive and mobile-first website.
+
I want to report on that data internally to see my best potential prospects.
  
== Development ==
+
I want to include that data in marketing to show prospects that they need to upgrade. Or that they have a number of extensions.  Including large amounts of data in a marketing message would be best in the form of a "free report'.  The reporting interface can also be used as an ad-hoc intelligence reporter and collector.
  
For details, see [[Wiki report/development]]
+
Is there an API for inserting data into CiviCRM? (Yes CiviCRM has a full API) Or, do I need to rely on the import tools and formatting my CSV with the correct external ID so as to avoid duplicates?
  
[[Category:Pages included in equality-technology.com]]
+
The basic UI for What's that Wiki Running? could be handled by [[jQuery]], but with [[Bootstrap]] added in, we get a bit more stylesheet.  Still, do we need that?  [https://api.jquery.com/category/ajax/global-ajax-event-handlers/ jQuery can handle the AJAX] Simple [http://www.zachhunter.com/2010/04/json-objects-to-html-table/ JavaScript could handle the data presentation] (and jQuery probably has some useful methods) and we can add [https://jqueryui.com/ jQuery UI] for advanced interactions or widgets.
 +
 
 +
To do cross-domain javascript requests, we'll need jsonp but, it turns out that you just can't make a secure AJAX UI to insecure web content (Duh!).
 +
 
 +
In the jQuery <code>.ajax</code> method, there are several settings.  The 'error' setting is a callback, and we could write a function there to try other variations on the domain to find the API endpoint.
 +
 
 +
Interesting example: http://en.banglapedia.org/index.php?title=Special:Version which uses [https://www.mediawiki.org/wiki/Skin:MediaWikiBootstrap the "MediaWiki Bootstrap" skin] See http://www.mediawikibootstrapskin.co.uk/index.php?title=Main_Page
 +
 
 +
I decided to use [[Bootstrap]] for this project.  At first, I was tempted to build a fully client-side framework and JavaScript solution.  Since CiviCRM has an API, I could potentially even use JavaScript for pushing data into the backend (authenticated with a secret).  Ultimately, Bootstrap was used on the client-side, but PHP was used to create the backend.
 +
 
 +
== Data Table systems in the UI ==
 +
 
 +
[https://datatables.net/examples/styling/bootstrap.html DataTables can integrate seamlessly with Bootstrap], but it's unlikely that I will need the robustness of [[Data Tables]] for this effort.  If I wanted to show many records, then yes.  But for now, I want to focus on showing the particular details of a specific wiki site.
 +
 
 +
DynaTables is a jQuery plugin that I began prototyping with, but again, it's not something that I will need since I don't have large datasets to manipulate.  I just want to focus on a single wiki at a time. [http://www.dynatable.com/#existing-json With existing JSON], you still have to know the 'layout' of your data and setup a blank table with the correct structure.  I'm more interested in a generic function that you could throw any JSON at, and it would spit out a table.
 +
 
 +
[https://labs.mbrooks.info/demos/Tidy-Table/ Tidy Table] is a jQuery plugin that creates HTML tables from the data that you feed into the client as JSON  The only interesting thing here is the fact that I might want to have something akin to their demo for the initial form state:  Allow the user to quickly/easily select which parts of the MW API they want to report on.
 +
 
 +
 
 +
{{References}}

Revision as of 09:28, 6 June 2015

Find out "What's that Wiki Running?" at https://freephile.org/wikireport


Background[edit | edit source]

The MediaWiki API offers great detail into what a MediaWiki wiki is running.

The ApiSandbox extension offers a GUI way to explore and even operate on the API [1]

The most popular data format for API communication is JSON.

PHP handles JSON consistent with the expanded definition of "JSON text" in the newer RFC 7159.

What I need to do is collect data, based on some data that I have in a CiviCRM comment (and the original csv file that was imported to CiviCRM), and re-import or add the new data to CiviCRM for market segmentation and intelligence.

I want to report on that data internally to see my best potential prospects.

I want to include that data in marketing to show prospects that they need to upgrade. Or that they have a number of extensions. Including large amounts of data in a marketing message would be best in the form of a "free report'. The reporting interface can also be used as an ad-hoc intelligence reporter and collector.

Is there an API for inserting data into CiviCRM? (Yes CiviCRM has a full API) Or, do I need to rely on the import tools and formatting my CSV with the correct external ID so as to avoid duplicates?

The basic UI for What's that Wiki Running? could be handled by jQuery, but with Bootstrap added in, we get a bit more stylesheet. Still, do we need that? jQuery can handle the AJAX Simple JavaScript could handle the data presentation (and jQuery probably has some useful methods) and we can add jQuery UI for advanced interactions or widgets.

To do cross-domain javascript requests, we'll need jsonp but, it turns out that you just can't make a secure AJAX UI to insecure web content (Duh!).

In the jQuery .ajax method, there are several settings. The 'error' setting is a callback, and we could write a function there to try other variations on the domain to find the API endpoint.

Interesting example: http://en.banglapedia.org/index.php?title=Special:Version which uses the "MediaWiki Bootstrap" skin See http://www.mediawikibootstrapskin.co.uk/index.php?title=Main_Page

I decided to use Bootstrap for this project. At first, I was tempted to build a fully client-side framework and JavaScript solution. Since CiviCRM has an API, I could potentially even use JavaScript for pushing data into the backend (authenticated with a secret). Ultimately, Bootstrap was used on the client-side, but PHP was used to create the backend.

Data Table systems in the UI[edit | edit source]

DataTables can integrate seamlessly with Bootstrap, but it's unlikely that I will need the robustness of Data Tables for this effort. If I wanted to show many records, then yes. But for now, I want to focus on showing the particular details of a specific wiki site.

DynaTables is a jQuery plugin that I began prototyping with, but again, it's not something that I will need since I don't have large datasets to manipulate. I just want to focus on a single wiki at a time. With existing JSON, you still have to know the 'layout' of your data and setup a blank table with the correct structure. I'm more interested in a generic function that you could throw any JSON at, and it would spit out a table.

Tidy Table is a jQuery plugin that creates HTML tables from the data that you feed into the client as JSON The only interesting thing here is the fact that I might want to have something akin to their demo for the initial form state: Allow the user to quickly/easily select which parts of the MW API they want to report on.


References[edit source]