python - Sensible way to create filenames for files based on URLs? -


i screenshotting bunch of web pages, using python selenium. want save pngs locally reference. list of urls looks this:

www.mysite.com/dir1/pagea www.mysite.com/dir1/pageb

my question filenames give screenshotted pngs.

if call image files e.g. www.mysite.com/dir1/pagea.png meaningless slashes inevitably cause problems @ point.

i replace / characters in url _, suspect might cause problems too, e.g. if there _ characters in url. (i don't strictly need able work backwards filename url, wouldn't bad thing.)

what's sensible way handle naming?

the easiest way represent what's directory structure on server wget , replicate structure on local machine.

thus / characters become directory delimiters, , www.mysite.com/dir1/pagea.png become png file called pagea.png in directory called dir1, , dir1 located in directory called www.mysite.com.

it's simple, guaranteed reversible, , doesn't risk ambiguous results.


-

Popular posts from this blog

Apache NiFi ExecuteScript: Groovy script to replace Json values via a mapping file -

i working apache nifi 0.5.1 on groovy script replace incoming json values ones contained in mapping file. mapping file looks (it simple .txt): header1;header2;header3 a;some text;a2 i have started following: import groovy.json.jsonbuilder import groovy.json.jsonslurper import java.nio.charset.standardcharsets def flowfile = session.get(); if (flowfile == null) { return; } flowfile = session.write(flowfile, { inputstream, outputstream -> def content = """ { "field1": "a" "field2": "a", "field3": "a" }""" def slurped = new jsonslurper().parsetext(content) def builder = new jsonbuilder(slurped) builder.content.field1 = "a" builder.content.field2 = "some text" builder.content.field3 = "a2" outputstream.write(builder.toprettystring().ge...
Read more

node.js - How do I prevent MongoDB replica set from querying the primary? -

read-operations-only: is there way have mongodb replica set, make mongodb instance on box connected to, mongodb gets queried? i have 3 ec2 instances behind aws load balancer. on each ec2 instance runs mongodb, part of replica set. i have express endpoints on nodejs , connect replica set follows mongodb.mongoclient.connect('mongodb://1.1.1.1,2.2.2.2,3.3.3.3.', function (err, db) { if (err) { complete('{}'); } else { i distribute load of queries evenly across 3 instances of mongodb replica set instead of default having queries routed ec2 instance primary mongodb defined, because destroys point of load balancer (which balance load of queries across 3 instances evenly). my understanding when connecting mongodb replica set, primary instance selected unless primary instance down, , therefore purpose of every secondary instance serve backup. in example people call hot,cold,cold. because there 2...
Read more