Summary:

  • Register nos. 1 to 4 xlxs files converted to csv and uploaded
  • Albums set up and photos successfully uploaded for Bristol Tramways and Carriage, CEB and CEGB Oakfield Road Bristol, Bath, Cornwall, Cornwall EWA Edmonds Collection
  • There are now 2125 photos in the system, less 127 “test” photos in Photos Album. Just over half of these are the Artefacts.
  • There are 7 more Registers to convert to CSV
  • Then there are 98 more folders of photos to upload – need to discuss how to rationalise this number before I go any further. The 98 folders contain around 7500 photos.

Next steps:

  • Convert remaining Register xlxs files to csv and upload them
  • Run them against each of the existing Albums to fill in any data gaps
  • Rationalise Albums needed
  • Upload remaining photos, one Album at a time
  • Review what photos still have missing data – rectify manually if need be (ouch!)
  • Deal with issues documented on post “Outstanding issues from 18/09/2016”

Detail:

The conversion process: (updated 26/10/2016)

  • Open Excel file – do not enable External Data Connections
  • Look for any multiple filenames in Column J “Photograph” and create duplicate lines, each with an individual filename
  • Copy columns M to T rows 1 and 2 from Table 2.xlsx into M1
  • Change M2 to formula to =J2

The contents of the two rows should now be:

file, id, item, location, date_made, description, comments, copyright

=J2, =A2, =B2&”_”&C2, =E2, =F2, =G2, =H2, =I2

  • Copy M2..T2 down to end of data
  • Highlight M1..T1 down to end of data and Copy
  • Highlight column V and paste values
  • Copy columns V..AC
  • Open new spreadsheet
  • Paste into A1
  • Save spreadsheet as CSV (MS-DOS) – “keep using that format”
  • Close CSV spreadsheet – do not save changes

============================

Did all the above for first 4 tables, i.e. Registers 1 to 4.
The Registers each contain a real mix of photos – the best bet will be to load a batch of photos to an appropriate Album, and run against all the CSV files to index them.

Set up new Albums down as far as 7.1 Cornwall EWA Edmonds Collection
Used Filezilla to copy CSV files up to Table 4 into Depot
(Bristol Tramways and Carriage, CEB and CEGB Oakfield Road Bristol, Bath, Cornwall, Cornwall EWA Edmonds Collection)

So now on to uploading:

=========================

Used Filezilla to copy Bristol Tramways and Carriage photos into Depot
Noted that photos seem to be called .jpg.jpg (double suffix) – we’ll sort that out later if we need to.

Import Photos – Default album Bristol Tramways and carriage
Ticked “Remove from depot after successful import”
Unticked “Do not create duplicates”
25 photos, 4 CSV files
Clicked Import
Response “Done processing files. 25 single photos imported. 4 CSVs imported, 16 photos processed. 3498 photos skipped”
Guessing that only 16 had data attached – checked in Album Admin, yes that is the case
*** INVESTIGATE NO-DATA PHOTOS LATER – DATA MAY BE IN ANOTHER REGISTER/TABLE ***

So it looks like we can use multiple CSV files at once with no problem – SUCCESS!

Repeated photo Filezilla for 5.1 CEB & CEGB Oakfield Road Bristol
Noted that photo 014 has filename .jpg (single suffix) but 015 has .jpg.jpg (double suffix) – check these as test cases
Changed default Directory, clicked Import

Response: “Done processing files. 4 CSVs imported, 20 photos processed. 4370 photos skipped”
But there were 40 photos, and they’ve all disappeared from Depot. However they’re all visible in Album Admin, justa few without data. No problem.
Photos 014 and 015 both loaded OK regardless of whether single or double suffix.

Repeated photo Filezilla for 5.2 Bath (21 photos), change default directory, Import.
Response: “Done processing files. 21 single photos imported. 4 CSVs imported, 21 photos processed. 4349 photos skipped”

Repeated photo Filezilla for 7.0 Cornwall (93 photos), change default directory (OR I THOUGHT I DID!), Import.
Response: “Time out. 53 photos imported. Please restart this operation” – Import again.
Response: “Done processing files. 4 CSVs imported, 0 photos processed. 4259 photos skipped.”
But all photos has disappeared from depot.

Album Admin – shows Cornwall as having no photos yet in Album. Gone to wrong Album?
Yes, found them in Bath Album. Album Admin – Bulk – Move was an easy solution.
Cornwall Album now shows all 93 photos.

Repeated photo Filezilla for 7.1 Cornwall EWA Edmonds Collection (210 photos), change default directory, Import.
Response: “Time out. 95 photos imported. Please restart this operation” – 115 left – Import again.
Response: “Time out. 80 photos imported. Please restart this operation” – 35 left – Import again.
Response: “Done processing. 35 single photos imported. 4 CSVs imported, 206 photos processed. 3990 photos skipped”
Discrepancy of 4 photos, assumed no data.

=========================

Next steps:

  • Convert remaining Register xlxs files to csv and upload them
  • Run them against each of the existing Albums to fill in any data gaps
  • Upload remaining photos, one Album at a time
  • Review what photos still have missing data – rectify manually if need be (ouch!)