Retrieve data from top-1000-company site - Revision history

Wikicatglobe at 03:09, 18 October 2013

2013-10-18T03:09:41Z

← Older revision		Revision as of 03:09, 18 October 2013
Line 1:		Line 1:
	<accesscontrol>~~Administrators,,Cem,,Maysunshine~~</accesscontrol>		<accesscontrol>Main:MyGroup</accesscontrol>
	== Introduction ==		== Introduction ==

Cg_pham at 09:22, 4 October 2011

2011-10-04T09:22:42Z

← Older revision		Revision as of 09:22, 4 October 2011
Line 1:		Line 1:
			<accesscontrol>Administrators,,Cem,,Maysunshine</accesscontrol>
	== Introduction ==		== Introduction ==

Catglobe at 07:17, 7 April 2010

2010-04-07T07:17:28Z

← Older revision		Revision as of 07:17, 7 April 2010
Line 79:		Line 79:

	- Run Macro "top1000One" <br> - Run Macro "top1000Two" <br> - Run Macro "top1000Three" <br> - Run Macro "top1000Four" <br>		- Run Macro "top1000One" <br> - Run Macro "top1000Two" <br> - Run Macro "top1000Three" <br> - Run Macro "top1000Four" <br>

			=== Step 4 - ===

			Test your work, compare to original site http://top1000.dk/da/top1000/1/rank/ASC

	[[Category:Production_guidelines]]		[[Category:Production_guidelines]]

Catglobe at 06:36, 7 April 2010

2010-04-07T06:36:46Z

← Older revision		Revision as of 06:36, 7 April 2010
Line 1:		Line 1:
	== Introduction ==		== Introduction ==

	This Solution is used to retrieve data from site http://top1000.dk/ and then import to Catglobe system		This Solution is used to retrieve data from site http://top1000.dk/ and then import to Catglobe system

			<br>

	== Solution ==		== Solution ==

	We have		We have

	* Server Path: \catproc\Share\CatGlobe Teams\Production\Top 1000\		*Server Path: \catproc\Share\CatGlobe Teams\Production\Top 1000\
	* Use Tool Top1000dk.exe to get raw data from http://top1000.dk/ site from server path		*Use Tool Top1000dk.exe to get raw data from http://top1000.dk/ site from server path
	* Customize data, import to Excel file		*Customize data, import to Excel file
	* Run Macro (get Macro source code from from server path		*Run Macro (get Macro source code from from server path<br>
			*

			=== Step 1 - Generate files by Internal Tool ===

	~~=== Step 1 -~~ Generate ~~files by Internal Tool ===~~		*Run Top1000dk.exe Tool, input index of page. Generate all pages. Note: run only one instance of this tool at a time.

	* Run Top1000dk.exe Tool, input index of page. Generate all pages. Note: ~~run only one instance of this tool at a time~~.		[[Image:Top1000Tool 1.png]]<br>

	~~<Top1000Tool_1 Image>~~		*Go to your local C:\ to get exported files

	* Go to your local C:\ to get exported files		<br>

	=== Step 2 - Customize raw data ===		=== Step 2 - Customize raw data ===

	* Merge all files we get from step1 to one file		*Merge all files we get from step1 to one file
	* Replace character "~" as "$$" and "\|" as "$" (the purpose is separating into columns when importing these files to Excel)		*Replace character "~" as "$$" and "\|" as "$" (the purpose is separating into columns when importing these files to Excel)

	<~~Customize data Image~~>		<br>

	* Save file as txt format		[[Image:Customize Data.png]]

			<br>

			*Save file as txt format

			<br>

	=== Step 2 - Import to Excel ===		=== Step 2 - Import to Excel ===

	* Open Excel application -> select Data tab -> Get External data -> From Text		*Open Excel application -> select Data tab -> Get External data -> From Text
	* Browse the txt file we get from step2		*Browse the txt file we get from step2
	* Follow step 1: Choose Delimited option		*Follow step 1: Choose Delimited option

	<~~Import 1 Image~~>		<br>
	* Follow step 2: Unselect "Tab" option, Select "Other" option = @

	<Import 2 ~~Image~~>		[[Image:Import step 1.png]]

			<br>

			*Follow step 2: Unselect "Tab" option, Select "Other" option = @

			<br>

			[[Image:Import step 2.png]]

			<br>

	=== Step 3 - Customize Excel data ===		=== Step 3 - Customize Excel data ===

	Because of limitation of the original site http://top1000.dk/, we encounter some problems with Unicode and long names which are displayed as "..."		Because of limitation of the original site http://top1000.dk/, we encounter some problems with Unicode and long names which are displayed as "..."
	* Open file "Unicode name" from server path to get list of incorrect names and replacements.
	* Replace all incorrect unicode character in file we get from Step2 by correct ones. Tips: we use IFERROR and VLOOKUP functions

	~~<Vlookup Image>~~		*Open file "Unicode name" from server path to get list of incorrect names and replacements.
			*Replace all incorrect unicode character in file we get from Step2 by correct ones. Tips: we use IFERROR and VLOOKUP functions

	* Similarly, replace three-dot companies from the file 3-dot companies. ~~We get the list of replacements of three-dot companies from file "3-dot companies"~~		[[Image:Vlookup function.png]]

			*Similarly, replace three-dot companies from the file 3-dot companies. We get the list of replacements of three-dot companies from file "3-dot companies"

			<br>

	=== Step 3 - Run Macro ===		=== Step 3 - Run Macro ===

	* Get Macro source code from server path		*Get Macro source code from server path
	* Orderly run these functions:		*Orderly run these functions:
	- Run Macro "top1000One" <br>
	- Run Macro "top1000Two" <br>		- Run Macro "top1000One" <br> - Run Macro "top1000Two" <br> - Run Macro "top1000Three" <br> - Run Macro "top1000Four" <br>
	- Run Macro "top1000Three" <br>
	- Run Macro "top1000Four" <br>

	[[Category:Production_guidelines]]		[[Category:Production_guidelines]]

Catglobe: Created page with '== Introduction == This Solution is used to retrieve data from site http://top1000.dk/ and then import to Catglobe system == Solution == We have * Server Path: \catproc\Sha…'

2010-04-07T06:32:15Z

Created page with '== Introduction == This Solution is used to retrieve data from site http://top1000.dk/ and then import to Catglobe system == Solution == We have * Server Path: \catproc\Sha…'

New page

== Introduction ==

This Solution is used to retrieve data from site http://top1000.dk/ and then import to Catglobe system

== Solution ==

We have

* Server Path: \catproc\Share\CatGlobe Teams\Production\Top 1000\
* Use Tool Top1000dk.exe to get raw data from http://top1000.dk/ site from server path
* Customize data, import to Excel file
* Run Macro (get Macro source code from from server path

=== Step 1 - Generate files by Internal Tool ===

* Run Top1000dk.exe Tool, input index of page. Generate all pages. Note: run only one instance of this tool at a time.

<Top1000Tool_1 Image>

* Go to your local C:\ to get exported files

=== Step 2 - Customize raw data ===

* Merge all files we get from step1 to one file
* Replace character "~" as "$$" and "|" as "$" (the purpose is separating into columns when importing these files to Excel)

<Customize data Image>

* Save file as txt format

=== Step 2 - Import to Excel ===

* Open Excel application -> select Data tab -> Get External data -> From Text
* Browse the txt file we get from step2
* Follow step 1: Choose Delimited option

<Import 1 Image>
* Follow step 2: Unselect "Tab" option, Select "Other" option = @

<Import 2 Image>

=== Step 3 - Customize Excel data ===

Because of limitation of the original site http://top1000.dk/, we encounter some problems with Unicode and long names which are displayed as "..."
* Open file "Unicode name" from server path to get list of incorrect names and replacements.
* Replace all incorrect unicode character in file we get from Step2 by correct ones. Tips: we use IFERROR and VLOOKUP functions

<Vlookup Image>

* Similarly, replace three-dot companies from the file 3-dot companies. We get the list of replacements of three-dot companies from file "3-dot companies"

=== Step 3 - Run Macro ===

* Get Macro source code from server path
* Orderly run these functions:
- Run Macro "top1000One" <br>
- Run Macro "top1000Two" <br>
- Run Macro "top1000Three" <br>
- Run Macro "top1000Four" <br>

[[Category:Production_guidelines]]